High-Performance Data Pipeline Specialist

4 days ago

Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000
Senior Data Engineer

We are seeking a skilled Data Engineering Specialist with experience in designing and implementing scalable, high-performance data pipelines using cloud services like AWS and Databricks.

Key Responsibilities:
  • Design, develop, and maintain efficient data workflows using AWS and Databricks.
  • Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.
  • Leverage Databricks for advanced analytics, machine learning workloads, and big data frameworks.
  • Collaborate with cross-functional teams to deliver reliable and scalable data solutions.
  • Implement data governance, quality checks, and monitoring frameworks.
Required Skills:
  • 7+ years of experience in data engineering.
  • Strong hands-on experience with AWS cloud services (S3, Redshift, Glue, EMR, Athena, Lambda).
  • Expertise in Databricks (PySpark, Delta Lake).
  • Proficiency in Python and SQL for data transformation and querying.
  • Strong understanding of data warehousing, data modeling, and big data concepts.
Preferred Qualifications:
  • Familiarity with MLOps integration within Databricks.
  • Experience with real-time/streaming data processing.
  • Knowledge of infrastructure as code.

The ideal candidate will have a strong background in data engineering and be able to design and implement efficient data pipelines. Strong communication and collaboration skills are essential for this role.

In addition to technical skills, we are looking for a professional who is passionate about delivering high-quality results and working collaboratively as part of a team.

This is an exciting opportunity to join our organization and contribute to the development of innovative data-driven solutions. We offer a dynamic work environment, opportunities for growth and development, and a competitive compensation package.

  • Big Data Pipeline Specialist

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerJob Summary:We are seeking a skilled data engineer to fill this role at our organization. The ideal candidate will have 1–2 years of experience in data engineering and be proficient in building production-grade pipelines at scale.About the Role:Design, build, and maintain production-level data pipelines that handle terabytes of...

  • High-Performance Testing Specialist

    4 days ago

    Aurangabad, Maharashtra, India beBeeQuality Full time US$ 1,00,000 - US$ 1,50,000

    Job Title: Quality Assurance SpecialistGoQuant is a cutting-edge financial technology company that delivers high-performance trading solutions for digital assets. We empower professional traders and institutions with a comprehensive suite of tools, including advanced Order Execution and Management Systems (OEMS), high-quality Market Data services, and robust...

  • High-Performance Data Architect

    4 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 17,10,000 - ₹ 25,10,000

    Big Data Engineer PositionWe are seeking an experienced Big Data Engineer to join our data engineering team. This role involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka, as well as experience in...

  • High-Performing Specialist Wanted

    4 days ago

    Aurangabad, Maharashtra, India beBeePerformance Full time ₹ 16,50,000 - ₹ 20,25,000

    Role SummaryWe are seeking a highly skilled and motivated performance specialist with 5+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you.About UsOur company is a product engineering organization that works on innovative projects with top-tier professionals. We cater to various use-cases...

  • Data Engineering Specialist

    7 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Engineering SpecialistWe are seeking a skilled data specialist to develop and maintain ETL pipelines, implement client-specific data transformations, and optimize database queries.Key Responsibilities:Develop and Maintain ETL PipelinesImplement Client-Specific Data TransformationsSupport Data Ingestion and Quality ChecksOptimize Database...

  • AI Driven Data Pipelines Architect

    1 week ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    About Our PlatformWe are building a cutting-edge, AI-driven trading platform that ingests vast streams of financial, alternative, and sentiment data and transforms them into actionable insights for informed decision-making.Our mission is to integrate robust data engineering pipelines with Generative AI and advanced ML models to democratize access to...

  • Senior Data Pipeline Developer

    4 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer – Data PipelinesAbout the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. You will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key...

  • High-Performance Backend Developer

    5 days ago

    Aurangabad, Maharashtra, India beBeeBackend Full time ₹ 2,00,00,000 - ₹ 2,70,00,000

    Job DescriptionWe are seeking a highly skilled Backend Developer to join our technical team and architect the backend foundation of our industry-leading FinTech mobile app.The platform will be powered by AI-driven insights, ultra-low-latency systems, and transparent user experiences. You will design and implement high-performance backend systems that handle...

  • Lead Data Specialist

    4 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Lead Data SpecialistWe are seeking an experienced Lead Data Specialist to design, build and optimize data pipelines using Azure Cloud technologies.

  • High-Performance Backend Developer

    4 hours ago

    Aurangabad, Maharashtra, India beBeeBackend Full time ₹ 25,00,000 - ₹ 30,00,000

    Job DescriptionOur team is expanding and seeking a skilled Backend Developer to help us build scalable solutions.Key Responsibilities:API Development: Design, develop, optimize, and maintain high-performance RESTful APIs using Node.js and MongoDB.Scalability & Performance: Optimize backend performance for handling large data volumes and high-traffic...