Senior Data Engineer

9 hours ago

Anand, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Description

We are seeking an accomplished Data Engineer to lead the design, development, and deployment of scalable data pipelines. As a key member of our team, you will be responsible for developing and maintaining data processing workflows using PySpark and Python.

You will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust data solutions. Your expertise in designing and implementing data ingestion, transformation, and integration solutions for structured and unstructured data will play a critical role in driving our business forward.

In this position, you will have the opportunity to optimize Spark jobs for performance and cost efficiency on cloud platforms. You will also lead, mentor, and guide a team of data engineers, ensuring best practices in coding, testing, and deployment. Additionally, you will establish and enforce data engineering standards, code reviews, and documentation.

Your strong leadership skills, experience working with Databricks or similar cloud-based Spark platforms, and solid understanding of distributed computing, big data architectures, and data modeling will be invaluable assets to our organization.

We offer a collaborative and dynamic work environment that fosters growth and learning. If you are a motivated and experienced professional looking to take your career to the next level, we encourage you to apply.

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 10+ years of professional experience in data engineering
  • Strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts
  • Extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and optimization techniques
  • Proficiency in Python and PySpark for data processing tasks
  • Experience working with cloud platforms such as AWS, Azure, or GCP
  • Familiarity with data storage technologies like HDFS, S3, Delta Lake, and relational/non-relational databases
  • Strong leadership skills with experience leading and mentoring engineering teams
  • Excellent problem-solving, communication, and collaboration skills

  • Senior Data Engineer

    6 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Design, develop, and maintain large-scale data pipelines using PySparkCollaborate with cross-functional teams to integrate data into cloud-based data platformsDevelop and implement data processing solutions using Spark SQL, DataFrame, and RDD...

  • Senior Data Engineer

    2 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 19,00,000

    Senior data engineer is responsible for designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have experience with Airflow, Python, and Snowflake, as well as strong problem-solving skills and the ability to work in a fast-paced environment.Our team is based in Pune, Bengaluru, and Chennai, and we offer a...

  • Senior Data Engineering Leader

    4 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned data engineering professional to lead our team of senior engineers in delivering high-quality features and maintaining Spark applications.The ideal candidate will have extensive experience in software development, focusing on backend and data engineering, with a strong background in Python, JVM, and Shell Scripting.A...

  • Senior data engineer – gcp

    2 weeks ago

    Anand, Gujarat, India Xebia Full time

    ???? We're Hiring: Senior Data Engineer – GCP | Big Data | Databricks???? Locations: Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal???? Shift Timing: 2:00 PM – 10:00 PM IST???? Experience: 8+ Years???? Immediate Joiners Only (0–15 Days Notice)Are you an expert Data Engineer ready to build large-scale data platforms on Google Cloud...

  • Senior Data Engineer

    6 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are seeking a senior data engineer to lead our serverless data pipeline.Location - Chennai/Bangalore/HyderabadRole - FTEAvailability - ImmediateWe require the candidate to have experience in designing and implementing data ingestion/transformation using AWS services.The ideal candidate will be able to move clients towards an ELT approach, aligning with...

  • Senior Data Engineer

    2 days ago

    Anand, Gujarat, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Senior Data Engineering Professional

    2 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking a highly skilled data engineering professional to join our organization.The ideal candidate will have a strong background in designing and developing large-scale data pipelines using technologies such as SQL, Python, and PySpark. They should also possess hands-on experience with distributed...

  • Data Engineer

    1 week ago

    Anand, Gujarat, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Senior Data Engineer

    1 week ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineer - ETL ExpertWe are seeking a skilled data engineering professional who is comfortable working on complex data engineering tasks with a focus on developing and maintaining efficient ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Data Engineering Responsibilities:Design and implement scalable ETL pipelines using...

  • Senior Data Architect

    7 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 2,00,000

    Job DescriptionAs a Senior Data Engineer, you will be responsible for designing and implementing scalable data architectures, building real-time and batch processing workflows, and optimizing data solutions on cloud platforms.The ideal candidate will have 4+ years of experience in data engineering, with expertise in Pyspark, Databricks, SQL, Azure/AWS/GCP,...