Expert Data Engineer

24 hours ago

Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Data Engineering Expert

We are seeking an experienced Data Engineering Expert to join our team.

The ideal candidate will have a deep understanding of data engineering principles and practices, with expertise in designing and implementing robust data pipelines using Databricks, PySpark, and SQL.

This role requires the ability to work independently in a fast-paced environment, collaborating with cross-functional teams to deliver efficient solutions.

  • Design and Develop Scalable Data Pipelines: Utilize Databricks, PySpark, and SQL to design and implement scalable and reliable data pipelines.
  • Collaborate with Cross-Functional Teams: Work closely with data architects, analysts, and business stakeholders to understand data requirements and deliver effective solutions.
  • Implement CI/CD Pipelines: Ensure smooth deployment and integration across environments by implementing CI/CD pipelines for data workflows.
  • Troubleshoot Performance Issues: Optimize and troubleshoot performance issues in existing pipelines to ensure optimal data processing.
  • Develop Unit Test Cases: Create and maintain unit test cases to ensure data accuracy and reliability.
  • Leverage MongoDB: Work with MongoDB, leveraging its aggregation framework for efficient data querying and document data flows.

Key Qualifications:

  • 5-8 years of professional experience in Data Engineering or related roles.
  • Deep expertise in the Databricks platform.
  • Strong programming skills in Python, PySpark, and SQL.
  • Proficiency in SQL.
  • Experience with CI/CD practices and tools.
  • Solid experience in implementing and maintaining unit test cases.
  • Good understanding and practical experience with MongoDB.

Requirements:

The ideal candidate will have strong problem-solving skills and the ability to work independently in a fast-paced environment.

  • Data Engineering Expert

    24 hours ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 24,50,000

    Job Title: Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert with extensive experience in designing, building, and optimizing data pipelines and ETL processes in Azure Databricks.The ideal candidate will have a strong background in SQL, Python, and PySpark, as well as a solid understanding of delta tables, Apache Spark, and Unity...

  • Data Engineering Expert

    4 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    Data Engineering Expert WantedWe are seeking a skilled Data Engineer to join our engineering team for an international enterprise.This is a 6-month full-time contract opportunity that requires the candidate to have strong expertise in data engineering and experience with Palantir Foundry, PySpark, and TypeScript.Palantir Foundry /...

  • Expert Data Engineer

    5 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000

    Data Engineering Expert WantedWe are seeking a highly skilled and experienced professional to lead our data engineering efforts.Responsibilities:Design, develop, and maintain large-scale data systems using Python and PySpark.Create complex SQL queries for data transformation, validation, and analysis.BUILD scalable, reusable code frameworks with a dynamic...

  • Data Engineering Expert

    18 hours ago

    Pune, Maharashtra, India beBeeExpert Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewThe role of a Data Engineering Expert involves designing, building, and maintaining large-scale data systems. This position requires expertise in Apache Kafka and the AWS data stack, as well as proficiency in coding languages such as Python, SQL, and Java.Key Responsibilities:Develop and maintain real-time data pipelines using Apache Kafka and...

  • Cloud Data Engineering Expert

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    GCP Data Engineering LeadWe are seeking a highly experienced professional to join our team in this key role.Key Responsibilities:Prepare detailed designs aligned with high-level architecture provided by project leadsBuild and deploy data processing systems based on design specificationsApply optimized development approaches using GCP BigQuery and Airflow for...

  • Expert Data Pipeline Engineer

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Expert Data Pipeline EngineerAbout the RoleWe are seeking an experienced Data Engineer to craft and maintain robust data pipelines, ensuring efficient extraction, transformation, and loading (ETL) of data.Key Responsibilities:Design, develop, and implement scalable data pipelines using Python and SQL.Collaborate with teams to integrate machine...

  • Data Operations Engineer

    5 hours ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Design Engineer

    3 hours ago

    Pune, Maharashtra, India Awign Expert Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job DescriptionLocation: PuneDuration: 12 Months with possible extensionOverall Experience: Minimum 10 YearsThe Design Engineer will own the maintenance and strategic roadmap for our Core design system. In this role, they will ensure the system is operational and meets the needs of our business users. They'll drive the future of the design system ensuring...

  • Expert Data Infrastructure Engineer

    2 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking an expert in data infrastructure to design and develop comprehensive knowledge graphs on the Databricks Data Intelligence Platform.Key Responsibilities:Create scalable, flexible, and adaptable ontologies based on BFO and CCO principles, aligning with business requirements and industry standards.Collaborate with domain experts to formalize...

  • Data Security Expert

    2 days ago

    Pune, Maharashtra, India beBeeCybersecurity Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cybersecurity Engineer - Data Security SpecialistWe are seeking a skilled and dedicated cybersecurity expert with a focus on data security to fill this critical role.