Senior Large-Scale Data Specialist

1 day ago

Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Role Overview

This is a contract remote role. We are seeking a highly motivated Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.

·         Location: India. Remote.

·         Job type: Contract

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications:

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Large Scale Data Engineer

    3 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Large Scale Data EngineerWe are seeking an experienced Large Scale Data Engineer to join our team.Design, build, and maintain production-level data pipelines that handle large amounts of structured and unstructured data.Own end-to-end ETL/ELT processes, ensuring reliability, scalability, and high availability.Work with cloud services (S3, EC2, RDS, DynamoDB,...

  • Senior Data Infrastructure Specialist

    4 hours ago

    Aurangabad, Maharashtra, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Infrastructure SpecialistWe are seeking a highly skilled Data Infrastructure Specialist to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data pipelines and architectures.The ideal candidate will have 3+ years of experience in working with Python, SQL, PySpark, and bash...

  • Senior ETL Specialist

    4 hours ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior ETL SpecialistETL Tester PositionWe are seeking a skilled professional to fill the role of Senior ETL Specialist.Key Responsibilities:Execute comprehensive testing across complex data pipelines and enterprise-grade data systems.Develop and execute sophisticated SQL queries for data validation, reconciliation, and transformation checks.Build...

  • Senior Cloud Data Engineering Specialist

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 14,01,600 - ₹ 20,16,000

    Job DescriptionWe are seeking a highly skilled Senior Cloud Data Engineering Specialist to design and develop scalable data pipelines using Python and PySpark. This role involves translating business requirements into technical solutions using AWS cloud services and programming languages.Key ResponsibilitiesDesign, develop, and maintain large-scale data...

  • Digital Marketing Strategist

    4 days ago

    Aurangabad, Maharashtra, India beBeeMarketing Full time US$ 84,000 - US$ 1,20,000

    Job SummaryWe are seeking a skilled Digital Marketing Strategist to manage and optimize large-scale Google Ads campaigns across multiple markets.This role involves planning, launching, and continuously improving Search, Display, YouTube, and Performance Max campaigns.The ideal candidate will have 3-5+ years of direct experience managing Google Ads campaigns,...

  • Real-time Data Infrastructure Specialist

    1 week ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Real-time Data Infrastructure SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data infrastructure, focusing on real-time data processing.

  • Expert Data Engineer

    1 week ago

    Aurangabad, Maharashtra, India beBeeBigDataSpecialist Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title:Senior Big Data SpecialistWe are seeking a skilled Senior Big Data Specialist to help us design, develop, and maintain large-scale data pipelines.Responsibilities:Design and implement scalable data pipelines using SparkDevelop expertise in Spark SQL, DataFrame, and RDD APIs for complex business logic implementationProficient programming skills in...

  • Data Platform Architect

    4 days ago

    Aurangabad, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    Senior Data Engineering SpecialistThe ideal candidate will be responsible for delivering end-to-end data modules and platforms that power core business use cases across real-time bidding, reporting, and analytics.Own the design, optimization, and maintenance of scalable data pipelines using a mix of SQL, NoSQL, and Big Data tools.Collaborate with product...

  • Senior Data Engineer

    4 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 19,00,000

    Senior Data Engineer Job OpportunityWe are seeking a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.To succeed in this role, you should have:Technical Skills:A strong understanding of data engineering concepts, including data...

  • Data Architect Specialist

    4 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time US$ 9,00,000 - US$ 12,00,000

    Job Title:Data Architect SpecialistAbout the Role:We are seeking a highly skilled Data Architect Specialist to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data platforms.Main Responsibilities:Design and implement end-to-end data pipelines using cloud-based services.Build and maintain...