Scalable Data Engineer

1 day ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000
Job Title: Scalable Data Engineer

We are seeking a highly skilled Big Data Engineer with deep expertise in designing and implementing scalable data engineering solutions. The ideal candidate will bring strong hands-on experience in architecting and optimizing Big Data architectures using AWS services.

Key Responsibilities:

  • Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
  • Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Architect and operationalize data engineering and analytics platforms (AWS preferred).
  • Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
  • Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
  • Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
  • Collaborate with cross-functional teams to provide technical leadership and strengthen the data engineering capability.
  • Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications:

  • Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark mandatory)
  • Proven expertise in Spark with Scala
  • Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

Benefits:

By joining our team, you will have the opportunity to work on cutting-edge projects, collaborate with experienced professionals, and grow your skills and knowledge in Big Data technologies.

What We Offer:

A dynamic and supportive work environment, opportunities for career growth and development, and a competitive compensation package.

  • Unlock Data Excellence as a Scalable Data Engineer

    4 hours ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock Data Excellence as a Scalable Data EngineerWe are seeking an accomplished Scalable Data Engineer to join our team, where you will play a vital role in shaping our data-driven strategy.

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Designing Scalable Data Systems

    3 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer PositionThis position is focused on designing, building and maintaining large-scale data processing systems.Key Responsibilities:Develop efficient ETL processes using Python, SQL and Apache Beam to transform and load data from various sources into BigQuery and other GCP tools.Work with cloud-based technologies such as Dataflow, Cloud...

  • Scalable Data Solutions Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Engineering Expert Sought for Scalable SolutionsWe are searching for an experienced Senior Data Engineer to develop and maintain robust data solutions.Responsibilities:Design and implement scalable data architectures.Integrate Adobe Experience Manager with cloud-based systems.Support digital and analytics initiatives.Requirements:6+ years of experience...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Senior Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Designing Scalable Data Solutions

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time US$ 1,01,376 - US$ 1,73,232

    Job Title: Data EngineerYou will be responsible for building solutions integrating data pipelines & ML models. You will design, develop, and maintain scalable and reliable batch data pipelines using Python and Java, leveraging industry standard frameworks like Dataflow.

  • Unlock Scalable Data Solutions

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Description", "As a Data Engineer, you will play a pivotal role in designing and building scalable data pipelines and infrastructure that support real-time and batch data processing.", "You will collaborate with cross-functional teams to deliver reliable, high-quality data systems that power analytics, insights, and data-driven decision-making. Your...