About Course
This class is intended for experienced developers and data engineers who are responsible for managing big data transformations including ETL, Data Processing, querying datasets, visualizing query results and creating reports
- Our Recruitment company details and open roles:https://lsarecruit.zohorecruit.in/careers
Duration: 1month ( Mon to fri, Sat & Sun 9am to 2pm ) - For fee and job assistance please call us on : 02033710546 or 07843259631 Email us : training@Lsatraining.co.uk
- Course Overview
- Course Content
- Highlights
Prerequisites:
To get the most of out of this course, participants should have:
- Completed Google Cloud Fundamentals: Core Infrastructure
- Basic proficiency with common query language such as SQL Experience with data modelling, extract, transform, load activities.
- Developing applications using a common programming language
Audience:
This class is intended for experienced developers and data engineers who are responsible for managing big data transformations including ETL, Data Processing, querying datasets, visualizing query results and creating reports
Course Outline
The course includes presentations, demonstrations, and hands-on labs.
Placement assistance program through LSA Recruit:
At LSA TRAINING, we are committed to helping our students secure suitable job opportunities through our comprehensive Placement Assistance Program.
Key Features of the Program:
1. Scope: Our program assists LSA Training students in finding jobs in their desired industry sectors and roles.
2. Target Audience: Open to students who have successfully completed their training with LSA.
3. Employer Database: We maintain a database of potential employers relevant to students' skills and interests.
4. Partnerships: We establish partnerships with employers, attend career fairs, and participate in industry events to facilitate job placements.
5. Candidate Profiles: Detailed profiles are created outlining students' skills, knowledge, experience, and qualifications.
6. Career Coaching: We offer career advice, resume development, and interview preparation services.
7. Job Matching: Students are matched with potential employers based on their profiles and job requirements.
8. Interview Arrangements: We coordinate interviews between students and employers.
9. Feedback: Post-interview feedback is provided to help students improve their job search skills.
10. Success Monitoring: We track the success rate of placements and gather feedback from students and employers to continuously improve our services.
Contact Us:
For more details on our Recruitment Program, visit [www.Lsarecruit.co.uk], call us at +44 02039501453, or email us at Careers@Lsarecruit.co.uk.
Empower your career with LSA TRAINING and LSA Recruit.
- Explore the role of a data engineer.
- Analyse data engineering challenges.
- Intro to BigQuery.
- Data Lakes and Data Warehouses.
- Demo: Federated Queries with BigQuery.
- Transactional Databases vs Data Warehouses.
- Website Demo: Finding PII in your dataset with DLP API.
- Partner effectively with other data teams.
- Manage data access and governance.
- Build production-ready pipelines.
- Review GCP customer case study.
- Lab: Analysing Data with BigQuery.
- Introduction to Data Lakes.
- Data Storage and ETL options on GCP.
- Building a Data Lake using Cloud Storage.
- Optional Demo: Optimizing cost with Google Cloud Storage classes and Cloud Functions.
- Securing Cloud Storage.
- Storing All Sorts of Data Types.
- Video Demo: Running federated queries on Parquet and ORC files in BigQuery.
- Cloud SQL as a relational Data Lake.
- Lab: Loading Taxi Data into Cloud SQL.
- The modern data warehouse.
- Intro to BigQuery.
- Demo: Query TB+ of data in seconds.
- Getting Started.
- Loading Data.
- Video Demo: Querying Cloud SQL from BigQuery.
- Lab: Loading Data into BigQuery.
- Exploring Schemas.
- Demo: Exploring BigQuery Public Datasets with SQL using INFORMATION_SCHEMA.
- Schema Design.
- Nested and Repeated Fields.
- Demo: Nested and repeated fields in BigQuery.
- Lab: Working with JSON and Array data in BigQuery.
- Optimizing with Partitioning and Clustering.
- Demo: Partitioned and Clustered Tables in BigQuery.
- Preview: Transforming Batch and Streaming Data.
- EL, ELT, ETL.
- Quality considerations.
- How to carry out operations in BigQuery.
- Demo: ELT to improve data quality in BigQuery.
- Shortcomings.
- ETL to solve data quality issues.
- The Hadoop ecosystem.
- Running Hadoop on Cloud Dataproc.
- GCS instead of HDFS.
- Optimizing Dataproc.
- Lab: Running Apache Spark jobs on Cloud Dataproc.
- Cloud Dataflow.
- Why customers value Dataflow.
- Dataflow Pipelines.
- Lab: A Simple Dataflow Pipeline (Python/Java).
- Lab: MapReduce in Dataflow (Python/Java).
- Lab: Side Inputs (Python/Java).
- Dataflow Templates.
- Dataflow SQL.
- Building Batch Data Pipelines visually with Cloud Data Fusion.
- Components.
- UI Overview.
- Building a Pipeline.
- Exploring Data using Wrangler.
- Lab: Building and executing a pipeline graph in Cloud Data Fusion.
- Orchestrating work between GCP services with Cloud Composer.
- Apache Airflow Environment.
- DAGs and Operators.
- Workflow Scheduling.
- Optional Long Demo: Event-triggered Loading of data with Cloud Composer, Cloud Functions, Cloud Storage, and BigQuery.
- Monitoring and Logging.
- Lab: An Introduction to Cloud Composer.
- Processing Streaming Data.
- Cloud Pub/Sub.
- Lab: Publish Streaming Data into Pub/Sub.
- Cloud Dataflow Streaming Features.
- Lab: Streaming Data Pipelines.
- BigQuery Streaming Features.
- Lab: Streaming Analytics and Dashboards.
- Cloud Bigtable.
- Lab: Streaming Data Pipelines into Bigtable.
Training Highlights
Interactive Learning: Enhanced interaction between students and faculty, as well as among students.
Comprehensive Materials: Detailed presentations with soft copy materials available for reference at any time.
Practical and Job-Oriented Training: Focus on practical skills with hands-on practice using software tools and real-time project scenarios.
Preparation for Interviews: Includes mock interviews, group discussions, and interview-related questions.
Cloud-Based Test Lab: Access to a cloud-based test lab for practicing software tools as needed.
Real-Time Project Domains: Discussions on real-time project domains to provide relevant context and experience.
Current Market Relevance: Teaching methods, tools, and topics are selected based on the current competitive job market.
Additional Course Benefits
Hands-On Experience: Gain practical experience with industry-relevant tools and techniques.
Real-Time Project Work: Work on real-time projects to build your portfolio and practical knowledge.
Interview-Based Training: Tailored training to help you excel in job interviews.
Expected Salary/Pay Package Guidance:
Contractors: £400 to £600 per day, depending on experience and skill set.
Permanent Positions: £50,000 to £100,000 per annum, based on experience and skills.
