Senior Data Engineer

3 days ago

Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

Job Title: Data Scientist and Engineer

Key Responsibilities:

  1. Design, develop and deploy scalable data pipelines using Apache Spark.
  2. Craft high-quality data processing workflows using PySpark and Python.
  3. Work closely with cross-functional teams to understand data requirements and deliver robust solutions.
  4. Architect and implement data ingestion, transformation and integration solutions for structured and unstructured data.
  5. Optimize Spark jobs for performance and cost efficiency on cloud platforms.
  6. Lead a team of engineers, ensuring best practices in coding, testing and deployment.
  7. Establish and enforce engineering standards, code reviews and documentation.
  8. Troubleshoot and resolve complex data pipeline issues.
  9. Stay current with emerging technologies and recommend improvements to existing infrastructure.

Required Skills and Qualifications:

  1. Bachelor's or Master's degree in Computer Science, Engineering or a related field.
  2. 8+ years of experience in software development and data engineering.
  3. Strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts.
  4. Extensive experience with Apache Spark, including Spark SQL and optimization techniques.
  5. Proficiency in Python and PySpark for data processing tasks.
  6. Experience working with Databricks or similar cloud-based Spark platforms.
  7. Solid understanding of distributed computing, big data architectures and data modeling.
  8. Experience with cloud platforms such as AWS, Azure or GCP.
  9. Familiarity with data storage technologies like HDFS, S3, Delta Lake and relational/non-relational databases.
  10. Excellent problem-solving, communication and collaboration skills.

About the Role:

This is an opportunity to work on large-scale data projects, collaborate with talented engineers and scientists, and contribute to the growth of a dynamic organization.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work on challenging projects and learn from experienced professionals.
  • A collaborative and inclusive work environment.

  • Unlock Career Advancement as a Senior Data Engineer

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Career Advancement as a Senior Data EngineerJob Title: Senior Data Engineer (Lead)We are seeking an experienced Senior Data Engineer to spearhead our data engineering initiatives. With 6+ years of experience in data engineering or cloud computing data development, you will conceptualize, develop, and optimize ETL/ELT data pipelines using Apache Spark,...

  • Senior Data Solutions Engineer

    4 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions EngineerWe are seeking a highly skilled and experienced Senior Data Solutions Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data solutions that meet the needs of our business.The ideal candidate will have a strong...

  • Senior Data Engineer

    4 days ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering SpecialistWe're seeking a skilled Data Engineering Specialist to design, develop, and maintain scalable, high-performance data solutions using Databricks. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture.About the Role:The Data Engineering Specialist will...

  • Big Data Engineer Role

    1 week ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer - Big Data and AnalyticsWe are seeking a highly skilled Senior Data Engineer to lead the development of big data and analytics environments on Databricks.Main Responsibilities:Design, build, and maintain complex technical architectures on Databricks, ensuring scalability, reliability, and performance.Develop and implement efficient data...

  • Highly Skilled Data Engineer Wanted

    1 day ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Senior Data EngineerOur team is seeking a highly skilled and experienced Senior Data Engineer to join our Analytics Engineering team. As a key member of our team, you will collaborate with cross-functional teams to design, build, and deploy large-scale data processing systems that deliver critical insights to our customers and internal stakeholders.We are...

  • Senior Data Engineer for Transportation Analytics

    7 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,33,44,000 - ₹ 1,65,60,000

    Senior Data Engineer for Transportation AnalyticsWe are seeking a seasoned Data Engineer to join our team and drive the development of cutting-edge software solutions for transportation analytics. As a key member of our engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines, data processing jobs, and...

  • Senior Data Engineer

    4 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 19,00,000

    Efficiently design and implement scalable data infrastructure using cutting-edge tools.About the Role:Develop and maintain high-quality code for data processing and analysis, focusing on performance optimization and troubleshooting.Collaborate with cross-functional teams to integrate data engineering capabilities into the organization, driving business...

  • Data Engineer Leader

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time US$ 9,00,000 - US$ 13,00,000

    Job Title: Data Engineer LeadKey Responsibilities:Data Engineer Lead Job DescriptionThe role involves end-to-end delivery of data modules and platforms that power core business use cases across real-time bidding, reporting, and analytics.As a senior leader in the team, you will own the design and enhancement of data-heavy modules across ad serving,...

  • Senior Data Engineer

    2 days ago

    Kannur, Kerala, India Viasat Full time

    About usOne team. Global challenges. Infinite opportunities. At Viasat, we're on a mission to deliver connections with the capacity to change the world. For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries around the globe communicate. We're looking for people who think big, act fearlessly, and create an...

  • AWS Cloud Data Engineer

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:A Senior Data Engineer for Cloud Infrastructure DevelopmentJob Description:As a seasoned Senior Data Engineer, you will design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Key Responsibilities:Develop data processing and transformation workflows using Apache...