Senior Data Engineer

1 day ago

Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Data Engineer - Large Scale Data Processing Solutions

This is a contract remote role. We are seeking a highly motivated Senior Data Engineer with 3–4 years of experience in designing, building, optimizing and maintaining large-scale data processing solutions.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in cloud services.
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Data Scientist/ML Engineer

    2 weeks ago

    Vijayawada, Andhra Pradesh, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Senior Data Engineering Strategist

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering Strategist A senior data engineering strategist is required to lead and manage a team of experienced data engineers. The ideal candidate should have a strong background in enterprise-level data engineering roles with expertise in OLAP design, data warehousing concepts, and Snowflake. Key Responsibilities: Leverage...

  • Senior Data Engineer

    4 days ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerLocation: Flexible Work Location (FWR)Experience Level: Senior (4+ years)Employment Type: Full-timeJob SummaryWe are seeking a highly skilled and experienced Senior Data Engineer to lead our data scraping projects. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years...

  • Senior Data Engineer

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleAt our organization, we are seeking a skilled Senior Software Engineer/Technical Specialist to join our team. This role is ideal for an individual with expertise in data engineering, including experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.As a Senior Software Engineer/Technical Specialist, you will be responsible...

  • Senior Data Engineering Expert

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Data EngineerWe are looking for a skilled data engineer to join our team.The ideal candidate will have 5+ years of experience in ETL development and data engineering.In this role, you will be responsible for developing and maintaining data pipelines using FiveTran, DBT Cloud, and custom frameworks.You will work closely with the QC team to...

  • Lead Data Engineer

    4 days ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time US$ 8,00,000 - US$ 12,00,000

    Senior Data ArchitectWe are seeking a Senior Data Architect to lead the design and implementation of our data engineering solutions.In this role, you will be responsible for designing, building, and maintaining robust data pipelines that integrate multiple sources of data. You will work closely with cross-functional teams to ensure that data from various...

  • Unlock Your Potential as a Senior Data Engineer

    2 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - Azure Data BricksWe are seeking a skilled Senior Data Engineer to lead our team in delivering cutting-edge data solutions using Azure Data Bricks.This role involves designing, developing, and deploying scalable data pipelines and ETL processes using Databricks. You will optimize Spark jobs and ensure efficient data processing and...

  • Senior Data Engineering Specialist

    4 days ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering SpecialistJob DescriptionWe are seeking a skilled and experienced Data Engineer to join our team. As a key member of our organization, you will be responsible for designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in distributed data processing and...

  • Senior Data Engineering Specialist

    1 week ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About us:We are an ecommerce focused end-to-end data analytics firm assisting enterprises & brands in data-driven decision making to maximize business value. Our suite of work spans extraction, transformation, visualization & analysis of data delivered via industry-leading products, solutions & services. Our flagship product is a cloud-based ETL tool. We...

  • Senior Manager, Data Engineering Lead

    24 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineering Full time US$ 12,00,000 - US$ 15,00,000

    Senior Manager, Technology TestingLead comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives.Drive quality assurance across integrated systems, data workflows, and customer-facing applications while coordinating cross-functional testing efforts.Key Responsibilities:Develop and execute...