Data Engineer

5 days ago

Gurugram, India Collabera Digital Full time

Position Details:


Job Title: Data Engineer

Experience : 2+ years

Location: Pune


Job Details and Requirements:


Skills :: ETL development, Jenkins, Airflow, GitHub Actions, SQL, Python


Overview :

We are seeking a skilled ETL Developer / Data Engineer to join our team and contribute to critical data engineering projects. This role focuses on building and managing data pipelines, ensuring high-quality data flow from various sources, and supporting automation across environments. You will work closely with our data science and analytics teams to deliver end-to-end solutions.

Required Skills :

- ETL Development: Strong experience in ETL tools and techniques for building scalable, efficient data pipelines.

- Jenkins: Proficiency in configuring and managing Jenkins for pipeline automation.

- Apache Airflow : Experience in building and managing DAGs to orchestrate complex workflows.

- GitHub Actions : Hands-on experience in using GitHub Actions to set up CI/CD workflows for ETL pipelines.

- SQL: Advanced knowledge of SQL for data manipulation and ETL operations.

- Python: Strong Python programming skills, particularly in data manipulation and workflow automation.


Key Responsibilities :


- Develop and maintain ETL processes to integrate and transform data from various sources.

- Design, implement, and optimize data pipelines using tools like Apache Airflow and Jenkins to automate workflows and ensure efficient scheduling.

- Utilize GitHub Actions for CI/CD pipelines , enabling streamlined code deployment across environments.

- Write and optimize complex SQL queries for data extraction, transformation, and loading.

- Build robust data transformation scripts and ETL workflows in Python.

- Troubleshoot and debug ETL workflows, ensuring high availability, data accuracy, and performance.

- Collaborate with stakeholders to gather requirements and translate them into technical solutions.

- Maintain best practices for data governance, quality, and documentation.

  • Data Engineers/Modelers

    4 weeks ago

    Gurugram, India NTT DATA Services Full time

    Data Engineers/Modelers - 8+ years of experience mAnalyticsResponsibilitiesDevelop and implement data pipeline for ingestion , loading and transformation of data sets from other systemsDesign and develop logical and physical data models as per business requirements.Perform data analysis to identify relationships, patterns and trends in dataEnsure data...

  • Digital Engineering Engineer

    3 days ago

    Gurugram, India NTT DATA Services Full time

    Req ID: 295081 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Job Duties: Must have:...

  • Data Engineer

    3 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Eucloid - Data Engineer - Azure Databricks

    5 months ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Senior Data Engineer

    2 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Data Engineer

    3 weeks ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    4 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    4 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    4 weeks ago

    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    4 weeks ago

    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    8 hours ago

    Gurugram, India Markovate Full time

    Job Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...

  • Data Engineer

    2 days ago

    Gurugram, India Markovate Full time

    Job Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...

  • Data Engineer

    5 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Siemens Energy Full time

    Data Engineer About the Role Location India Haryana Gurugram Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Core Full / Part time Full-time Experience Level Experienced Professional A Snapshot of Your Day Data Engineer is an engineering role within a data...

  • Data Engineer

    4 months ago

    Gurugram, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...

  • Data Engineer

    3 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    2 weeks ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...