Data Engineering Specialist

1 day ago

India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Data Engineering Expert sought to spearhead foundational components development for Lakehouse architecture on AWS. This key leadership role entails driving migration of existing data processing workflows to new solution.

Main Responsibilities:
  • Design and Implement Scalable Data Infrastructure: Utilize technologies like Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog to create efficient data pipelines.
  • Migrate and Establish Data Quality Governance: Ensure successful transition and establish robust quality control across the platform, enabling reliable and efficient data processing.
Requirements:
  • Prior experience as Principal Engineer with expertise in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
  • Expertise in Python and Spark, with a focus on ETL data processing and engineering practices.
  • Deep knowledge of AWS data services and engineering practices, with experience implementing data pipelines using tools like EMR, AWS Glue, Lambda, Step Functions, API Gateway, and Athena.

The ideal candidate possesses exceptional problem-solving skills and can lead and mentor within an agile team. Additional programming languages and development tools are advantageous. A master's degree or relevant certifications can also be beneficial.

Key Skills: Cloud native architecture, software engineering, data engineering, data science, Python, PySpark, Apache Iceberg, AWS Glue, AWS EMR, data governance, data quality, DevOps.

  • Senior Data Engineer

    4 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Engineering Specialist

    2 days ago

    India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering Specialist">We are seeking a skilled professional to lead the design and development of our Big Data systems.">Main Responsibilities:">Develop, tweak and optimize queries using PySpark, Spark, Hive and Hadoop Big Data Eco System Tools.Work on performance enhancement of data processing tasks.Design and implement efficient data...

  • Senior Data Engineer

    6 hours ago

    India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Data Engineering Specialist Role**In today's data-driven world, effective data management is crucial for business success. As a Data Engineering Specialist, you will play a pivotal role in ensuring that data is efficiently managed and utilized to drive strategic insights and inform key decision-making.This critical position involves collaborating with...

  • Cloud Data Engineering Specialist

    7 days ago

    India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    **Job Title:** Cloud Data Engineering SpecialistWe are seeking a seasoned Cloud Data Engineering Specialist to join our team. As a key member of our engineering group, you will be responsible for designing, building, and operating scalable data pipelines and services.Key Responsibilities: Design, build, and operate production-grade data pipelines and...

  • Data Engineer

    2 days ago

    India LTIMindtree Full time

    We are hiring for AWS Data Engineer Experience - 5 to 7 Years Location : Chennai Notice period - immediate to 30 days Job Summary Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions 4 years of experience in GCP BQ Dataflow Airflow...

  • Data Specialist

    2 weeks ago

    India beBeeDataSpecialist Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data SpecialistOur company is seeking a highly skilled Data Specialist to join our team. This individual will be responsible for designing, developing, and maintaining large-scale data systems using Python and PySpark.Responsibilities:Develop and implement data processing pipelines using Python and PySparkDesign and maintain large-scale data...

  • Enterprise Data Engineer

    1 week ago

    India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Title: Enterprise Data Engineer & Infrastructure SpecialistWe're seeking a seasoned expert to oversee full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.This is an opportunity for you to work at the intersection of data engineering, infrastructure, and DevOps, and be part of...

  • Data Analyst

    1 week ago

    India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutions We are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team . In this role, you will analyze financial, customer, and transaction datasets ,...

  • Senior Engineer, Data Engineering

    4 days ago

    India HealthyMe Ai Full time

    About the Role We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Data Engineering Specialist

    6 days ago

    India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We're looking for a highly skilled software engineer to join our marketing data engineering team. This role requires a strong foundation in software development, with experience in building high-impact tools and platforms that empower data-driven decision-making.">The ideal candidate will have 2+ years of hands-on experience in software engineering, with a...