Senior Data Developer

1 week ago

Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

Data Engineer Position Overview

As a Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and ETL workflows. This role requires expertise in Spark, PySpark, and SQL to manage and process large datasets.

About the Role
  • Create scalable and efficient data pipelines using Spark and ETL tools.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Deploy and manage Spark workloads on cloud platforms like AWS, Azure, GCP, or Databricks.
  • Develop and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Ensure data quality, scalability, and performance in all pipelines.
Requirements
  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark, and data ingestion tools (Kafka, Flume, Kinesis).
  • Knowledge of data formats (Parquet, Avro, ORC) and orchestration tools (Airflow/Prefect).
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on cloud platforms and testing/CICD for data pipelines.
Key Skills
  • Spark Core API: RDDs, transformations/actions, DAG execution.
  • Spark SQL: DataFrames, schema optimization, UDFs.
  • Streaming: Structured Streaming, Kafka integration.
  • Data Handling: S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration: Airflow/Prefect.
  • Performance Tuning: Partitioning, caching, broadcast joins.
  • Cloud Deployment: Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI/CD: Pytest/unittest for Spark jobs.
Education & Soft Skills
  • Bachelor's/Master's in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.
Benefits

This position offers a competitive salary and opportunities for career growth in a dynamic environment.

  • Senior Data Development Specialist

    14 hours ago

    Vizag, Andhra Pradesh, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Development SpecialistThe Role:We are seeking a skilled data development specialist to play a key role in analyzing business requirements and designing data models to support informed decision-making.Key Responsibilities:Analyze business needs to identify data requirements and design effective data models.Design and model robust data...

  • Senior Data Engineer

    2 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 19,10,000

    **Senior Data Engineer Role**We are seeking a senior data engineer to join our team and contribute to the development of our data infrastructure.The ideal candidate will have a strong background in data engineering, with experience in designing, building, and maintaining large-scale data systems.The successful candidate will be responsible for:Designing and...

  • Senior Data Strategist

    16 hours ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are seeking experienced professionals to fill the role of Senior Data Strategist. As a member of our data-driven team, you will be responsible for developing and implementing advanced machine learning solutions.Key responsibilities include:Designing and developing predictive algorithms to solve complex business problems.Extracting actionable insights from...

  • Senior Data Developer

    6 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 25,00,000

    Job DescriptionAs a seasoned Data Analyst, you will play a vital role in crafting data pipelines that drive business growth. Your expertise in Databricks PySpark development will enable us to efficiently process large data volumes and extract valuable insights.The ideal candidate will have a strong background in ETL processes, with hands-on experience in...

  • Advanced Data Systems Developer

    6 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job Title:Senior Data Engineer", "About the Role:We are seeking an experienced data engineer to join our team. As a senior data engineer, you will be responsible for designing, developing, and automating large-scale ETL workflows using Python and Pandas.", "Key Responsibilities:Design and implement scalable ETL pipelines to handle complex supply chain...

  • Senior Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistKey Responsibilities:Design and develop high-performance data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and efficient data solutions.Collaborate with stakeholders to gather requirements and deliver actionable data insights.Optimize data workflows for...

  • Senior Geospatial Development Engineer

    1 week ago

    Vizag, Andhra Pradesh, India beBeeGeospatial Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Geospatial Development Engineer Avoid routine tasks, build a career that pushes boundaries. We're looking for a highly skilled Senior Geospatial Development Engineer to join our team. We are a forward-thinking company with a passion for innovation and technology. Our vision is to create cutting-edge solutions that transform industries and...

  • Senior Data Architect

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About this Role:As a senior data architect, you will be responsible for designing and implementing information solutions that support business objectives. This includes discovering data and analytics requirements, developing database solutions, and collaborating with stakeholders to gather and validate requirements.Main Responsibilities:Design and implement...

  • Senior Data Coordinator

    6 days ago

    Vizag, Andhra Pradesh, India beBeeDataManagement Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Summary:We are seeking a seasoned professional to fill the role of Senior Data Coordinator. This position involves managing project-specific and departmental documents, as well as coordinating with cross-functional teams to ensure seamless delivery.Key Responsibilities:Document Management: Responsible for tracking, reviewing, and controlling...

  • Senior Data Engineering Specialist

    4 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Engineer to lead a team of Senior Engineers and develop innovative data-intensive applications.The ideal candidate has 10+ years of experience in software development, with a focus on backend and data engineering. They should have hands-on experience in using Python, JVM, and Shell Scripting, as well as...