GCP Big Data Engineer
4 weeks ago
About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.
Job Title : GCP Big Data Engineer
Key Skills : PySpark , Airflow , SQL , GCP , ETL, Python, Big Quarry
Job Locations : Gurugram ,Bangalore
Experience : 6-10 years
Education Qualification : Any Degree Graduation
Work Mode : Hybird
Employment Type : Contract
Notice Period : Immediate - 10 Days
Job description:
Job Summary
We are seeking a seasoned GCP Data Analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions
Job Description
Design develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support largescale data analytics Utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently Collaborate with crossfunctional teams to gather requirements and deliver reliable data solutions Ensure data quality consistency and integrity across multiple data sources Monitor and troubleshoot data workflows to maintain high system availability and performance Stay updated with emerging trends and best practices in GCP data analytics and big data technologies
Roles and Responsibilities
Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow Develop scalable maintainable and reusable data pipelines to support business intelligence and analytics needs Optimize SQL queries and data models for performance and cost efficiency in BigQuery Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities Automate workflow orchestration using Apache Airflow for seamless data operations Collaborate with data engineers analysts and stakeholders to ensure alignment of data solutions with organizational goals Participate in code reviews testing and deployment activities adhering to best practices Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team
Skills
Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem
-
Lucknow, India Extreme Networks Full timeOver 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...
-
Data Quality Engineer
2 weeks ago
Lucknow, Uttar Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per yearJob Title : Data Quality Engineer (Data QE) Job Description :We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing...
-
Data Engineer
2 weeks ago
Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per yearDescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...
-
Data pipeline engineer
4 weeks ago
Lucknow, India JRD Systems Full timeThe Role: Backend and Data Pipeline Engineer:The Team: We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you...
-
Lead technical recruiter
6 days ago
Lucknow, India DynPro Inc. Full timeLead Recruiter — Core Tech (Data / Cloud / Integration) – US StaffingLocation: India (Remote/Hybrid) • Shift: US • Function: Talent Acquisition – US MarketAbout the roleWe’re scaling our Core Tech desk across Data (Snowflake, Databricks, Big Query, dbt), Cloud (AWS/Azure/GCP), Integration/Automation (Workato, Mule Soft, Boomi, Tray), and...
-
Senior ai engineer
3 weeks ago
Lucknow, India Chetty Technologies Full timeCompany DescriptionChetty Technologies is a specialized Technology Company providing high-end consulting services in the Banking & Finance, Telecom, Healthcare, and Hospitality domains. With offices in the US and India, we offer solutions in Application Development, AI & Machine Learning, Big Data & Analytics, Business Intelligence, Robotic Process...
-
Data Science Trainer
1 day ago
Lucknow, Uttar Pradesh, India UNI Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per yearDeliver training on data analysis, machine learning, and Python/R Strong knowledge of statistics and data visualization tools Experience with SQL and Big Data technologies Excellent communication and teaching skills required
-
Databricks data engineer
4 days ago
Lucknow, India Insight Global Full time** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...
-
AI/ML DATA Engineering
2 weeks ago
Gomtinagar, Lucknow, Uttar Pradesh, India DISPL Full time ₹ 4,20,000 - ₹ 9,60,000 per yearAI/ML Data EngineerWe are looking for a passionate AI/ML Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that power our machine learning and analytics initiatives.You will collaborate closely with data scientists, ML engineers, and...
-
Lucknow, India Trackzio Mobile Applications Private Limited Full timeAbout TrackzioTrackzio is a 1-year-old startup building mobile apps that improve productivity, health, and personal development. With a lean team of 9, we ship delightful, ai based, data-driven products—from habit trackers and child-care tools to hobbyist utilities for coin collectors, gardeners, and more.Role OverviewWe’re hiring a Node.js Backend...