Data Engineering Specialist

4 days ago

Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,92,000 - ₹ 25,16,000

We are seeking a highly skilled data professional to fill the role of Data Engineering Specialist.

The ideal candidate will have expertise in designing, developing, and maintaining efficient ETL processes using Databricks PySpark. As part of our team, you will be responsible for:

Main Responsibilities:
  • Design and develop robust ETL processes to extract, transform, and load data from various sources into our data lake and warehouse.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement effective error handling and monitoring mechanisms to detect and resolve issues within ETL processes.
  • Design and implement data solutions following best practices, organizing data into structured layers.
  • Evaluate and ensure data quality at each stage to support robust analytics and reporting.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • A minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming and extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, including RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven ability to work effectively with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
PREFERRED QUALIFICATIONS:
  • Experience with cloud platforms, preferably AWS.
  • Familiarity with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

  • Senior Data Engineer

    3 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Fabric Specialist

    4 days ago

    Guntur, Andhra Pradesh, India beBeeDataFabric Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Job Title: Data Fabric Specialist">Job Description:A key member of our team, the Data Fabric Specialist will design and implement scalable data solutions using Microsoft Fabric.This is an excellent opportunity for a skilled professional to utilize their expertise in Azure Data Platform and lead a team of data engineers, BI developers, and analysts in...

  • Data Ingestion Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Ingestion SpecialistWe are seeking a skilled Engineer to fill a Data Ingestion position.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management.

  • Senior Data Engineering Professional

    6 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer Role OverviewAbout the PositionWe are seeking a highly motivated and skilled data engineer to join our team as a Marketing Platform Specialist. The successful candidate will be responsible for extracting valuable data from marketing platforms, uncovering hidden API endpoints, and crafting high-quality datasets in Snowflake that fuel advanced...

  • AWS Data Engineer

    4 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering SpecialistWe are seeking a highly skilled Cloud Data Engineering Specialist to join our team.In this role, you will be responsible for designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.You will implement data processing...

  • Big Data Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Posting for Big Data SpecialistGreetings from our organization.We are seeking a seasoned Big Data Engineer to join our team. As a Big Data Specialist, you will be responsible for designing, developing, and implementing large-scale data processing systems using technologies such as PySpark and Hive.The ideal candidate should have at least 6 years of...

  • Data Engineering Specialist

    7 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 31,200

    Job OverviewWe are seeking an experienced data engineer to join our global team. The successful candidate will bring expertise in designing, developing, and maintaining large-scale data systems.The ideal candidate will have a strong background in Python, PySpark, SQL, and Palantir Foundry, with at least 5-8 years of experience as a data engineer.Key...

  • Senior IT Data Engineer

    5 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data Extraction SpecialistThe ideal candidate will have a minimum of 4 years of hands-on experience in IT data extraction, with at least 2 years leading a team of 5+ developers.This role requires deep technical knowledge in advanced data extraction techniques, reverse engineering, automation, and leadership skills to drive the team towards...

  • Data Governance Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataGovernance Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Data Governance Specialist Job Summary:A key role in supporting enterprise-level data governance initiatives. This includes overseeing structured and unstructured data domains, Microsoft 365, SharePoint, Teams, and internal ERP systems.This long-term position has strategic impact across global teams, including India and LATAM. The Data Governance Specialist...

  • Highly Skilled Data Engineer

    5 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineering ExpertWe are seeking a highly skilled Data Engineer to design, build, and operate scalable data pipelines.About the Role:This is a critical position where you will create event-driven data pipelines that process clinical encounter data.You will work closely with software engineers, ML specialists, and clinical partners to bring our...