Senior Data Pipeline Developer

2 days ago

Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 35,00,000

We are seeking a seasoned data professional to spearhead large-scale data pipeline development using cutting-edge technologies like PySpark, AWS, and Databricks.

The ideal candidate will possess extensive expertise in Python and SQL, with a proven track record of designing, building, and optimizing complex data pipelines.

Key Responsibilities:

  • Design and develop ETL/ELT pipelines that integrate disparate data sources and systems.
  • Perform in-depth data analysis, validation, and transformation using advanced statistical techniques and machine learning algorithms.
  • Optimize and monitor workflows for maximum performance, scalability, and cost efficiency.
  • Collaborate closely with analytics teams to surface actionable insights and drive business growth.
  • Troubleshoot and resolve complex data inconsistencies, configuration issues, and pipeline errors.
  • Work seamlessly with cross-functional teams to define and implement data requirements.

Qualifications:

  • Minimum 5 years of experience in data engineering with a strong background in Python, SQL, and related technologies.
  • Proven expertise in PySpark, AWS services, and Databricks, with a focus on scalable data architecture.
  • Proficiency in Linux/Bash scripting for automation and data operations, with a emphasis on reliability and maintainability.
  • Familiarity with Agile and CI/CD practices, with a passion for continuous improvement.
  • Strong problem-solving and communication skills, with experience in client-facing roles and ability to distill complex technical concepts into clear, concise language.

  • Senior Data Engineer

    3 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Senior Data Pipeline Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Job TitleA Data Engineer will be responsible for building and maintaining data pipelines, designing enterprise-grade data architectures, and collaborating with cross-functional teams.Key Responsibilities:Design, build, and maintain robust data pipelines and ETL/ELT processesDevelop data ingestion frameworks to collect data from various sources (databases,...

  • Data Pipeline Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 17,50,000

    Seeking a seasoned Ingestion Expert to spearhead data ingestion strategies. This role demands expertise in designing, developing, and optimizing data pipelines for integrating various sources into Databricks.Key Responsibilities:Design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Develop and maintain...

  • Senior Python Developer

    2 days ago

    Guntur, Andhra Pradesh, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Python Developer - Pipeline ArchitectWe are seeking an experienced and skilled Senior Python Developer to lead our pipeline architecture efforts.This role involves designing, building, and maintaining large-scale data pipelines using Apache Beam and Databricks.Key Responsibilities:Architecture and Reuse:Design and build a shared component...

  • Distinguished Data Pipeline Architect

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Role:We are seeking a seasoned Senior Data Engineer to join our team. This is a critical role responsible for designing, building, and maintaining our data pipeline architecture.This engineer will collaborate closely with data scientists and analysts to facilitate data-related functionalities.They will lead the optimization and scalability of data...

  • Data Pipeline Architect

    3 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Potential in Data EngineeringYour potential, unleashed. The global economy is evolving at an unprecedented rate, and it's a perfect time to unleash your skills in data engineering.You'll have the chance to combine our drive to propel with purpose with your passion for data engineering. You'll be part of a team that collaborates, innovates, grows,...

  • Data Pipeline Engineer

    5 days ago

    Guntur, Andhra Pradesh, India beBeeETLPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    ETL DeveloperWe are seeking a highly skilled and motivated ETL Developer to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake. Key Responsibilities:Design and Develop ETL PipelinesLeverage best practices for schema design, partitioning, and...

  • Data Pipeline Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to design and implement efficient data pipelines that transform large datasets into high-quality structured data.Key Responsibilities:Normalize heterogeneous data into structured outputs (CSV, SQL, JSON) for large-scale comparisons.Document workflows, maintain reusable extraction modules, and...

  • Chief Data Pipeline Architect

    8 hours ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Data Engineer RoleWe're seeking a skilled professional to lead our data engineering department, designing and building production-level data pipelines that handle large volumes of structured and unstructured data.

  • AI/ML Pipeline Developer

    5 hours ago

    Guntur, Andhra Pradesh, India beBeeArtificialintelligence Full time ₹ 6,00,000 - ₹ 10,00,000

    Unlock Your Potential as a Software Engineer Intern in AI/MLRole DescriptionThis is a full-time remote position for a talented individual to work on AI/ML pipelines, contributing to the development of innovative solutions in the interconnect design space. The role involves software development in Python for the back-end and React for the front-end web...