Master Data Engineer

4 days ago

Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,44,00,000 - ₹ 2,43,20,000

Job Summary:

We are seeking an experienced data engineer to design, develop, and maintain scalable ETL data pipelines using Python.

The ideal candidate will have a strong understanding of data pipeline architecture, data integration, and transformation techniques.

Main Responsibilities:

  • Design and implement efficient data ingestion processes from various sources.
  • Develop and maintain robust ETL data pipelines using Python.
  • Collaborate with cross-functional teams to understand data needs and deliver efficient data solutions.

Required Skills and Qualifications:

  • 10 to 12 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

Good to Have (Optional Skills):

  • Experience working with the Snowflake cloud data platform.
  • Hands-on knowledge of Databricks for big data processing and analytics.
  • Familiarity with Azure Data Factory (ADF) and other Azure data engineering tools.

Additional Details:

Requirements:

  • Bachelor's degree in Computer Science, a related field, or equivalent experience.

Desirable Skills:

Please note that this is not an exhaustive list. If you're passionate about data engineering and meet the required qualifications, we encourage you to apply.

  • Senior Master Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    About the RoleWe are seeking a skilled Data Engineer to join our team and contribute to the success of our Master Data Management (MDM) solutions. As a key member of our data engineering team, you will be responsible for analyzing and managing customer master data using Reltio or Informatica MDM solutions.You will perform advanced SQL queries and data...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Master Data Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataManager Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Assistant Manager">Job Summary:Inviting applications for the role of Assistant Manager Master Data Management. This is a unique opportunity to join our team as an experienced professional in managing master data.">Responsibilities:Identify requests for material master shared mailbox and log in daily tracker.Coordinate with material master...

  • Senior Data Engineer/Architect

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Mastering Data Engineering

    6 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    **Job Title:** Data Engineering LeadKey ResponsibilitiesDevelop and maintain data pipelines for data integration and ETL processes using Azure Data Factory (ADF) and Databricks.Design, implement, and optimize Power BI reports and dashboards to deliver actionable business insights.Collaborate with data analysts, business users, and other teams to understand...

  • Azure Data Engineer ll

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time US$ 90,000 - US$ 1,20,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ICE Data Services Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...

  • Computer Vision Engineer

    2 weeks ago

    Hyderabad, Telangana, India Master-Works Full time US$ 90,000 - US$ 1,20,000 per year

    Job Overview: Master-Works is looking for a skilled Computer Vision Engineer to join our innovative team. In this role, you will leverage your expertise in image processing and machine learning to design and implement advanced computer vision solutions. Your contributions will be pivotal in enhancing our product offerings and developing state-of-the-art...