Highly Skilled Senior Data Engineer Wanted

2 days ago

Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior Data Engineer Position

Job Overview:

We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.

Key Responsibilities:

  • Analyze and understand the current technology landscape to assess its impact on new requirements.
  • Develop efficient Spark jobs using Scala for new project needs.
  • Enhance existing Spark jobs for ongoing product enhancements.
  • Optimize Spark job performance through stress testing and other methods.
  • Create data pipelines for developed/enhanced Spark jobs using AWS Lambda or Apache Airflow.
  • Design databases, including logical and physical design, star schema, and snowflake schema.
  • Analyze data processing, integration, modeling, and reporting requirements, and define data loading strategies based on volume, data types, frequency, and analytics specifications.
  • Ensure optimal balance between cost and performance.
  • Document projects, adhere to quality guidelines, and meet schedules.
  • Collaborate with Project Managers for successful project delivery and provide estimation, scoping, and scheduling assistance.
  • Manage build phases and ensure code quality by fulfilling requirements and adhering to Cloud architecture standards.

Required Skills and Qualifications:

  • 7-9 years of IT experience.
  • 5+ years of experience in AWS-related projects.
  • Associate Level and Professional Level AWS Certification is a plus.
  • In-depth knowledge of the following AWS services is required: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases (must have): AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data (must have): Hadoop, Hive, Spark, YARN.
  • Programming Languages (must have): Scala, Python, Shell Scripts, PySpark.
  • Operating Systems (must have): Any Linux flavor, Windows.
  • Strong SQL skills are essential.
  • Orchestration Tools (must have): Apache Airflow.
  • Expertise in developing ETL workflows with complex transformations like SCD, deduplications, aggregations, etc.
  • Thorough understanding of AWS VPC, Subnets, Security Groups, and Route Tables.
  • Quick learner and adaptability to new AWS Services or Big Data Technologies is necessary.

Education and Certifications:

  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree is a plus).
  • Technical certifications or continuous learning demonstrated through one or more methods.
  • Minimum 5 years of experience in Cloud-related projects.

  • Highly Skilled Data Engineering Leader

    12 hours ago

    Surat, Gujarat, India beBeeData Full time ₹ 39 - ₹ 42

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced professional to lead our data engineering efforts.Key Responsibilities:Design and optimize large-scale data pipelines using ETL/ELT workflows, cloud platforms, and big data ecosystems.Develop scalable data platforms with AWS and leverage Spark, Kafka, Hive for processing.Create...

  • Highly Skilled Financial Data Engineer Wanted

    11 hours ago

    Surat, Gujarat, India beBeeSeniorDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About this role:We are seeking a Senior Data Engineer to contribute to the development and scaling of modern financial data platforms. This position involves working with Snowflake, dbt, and financial systems integration to provide trusted insights and accurate financial reporting for Accounting and Finance teams.As a key member of our engineering team, you...

  • Highly Skilled Senior Data Architect

    2 days ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About This RoleWe are seeking a highly skilled Senior Data Engineer to lay the foundation for our project, requiring strong technical expertise and leadership skills.This is an exceptional opportunity for a seasoned professional with 10-15 years of experience in software architecture and solution design, focusing on data engineering practices and expertise...

  • Highly Skilled Senior Developer Wanted

    11 hours ago

    Surat, Gujarat, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Full Stack Software EngineerWe are seeking an experienced and skilled Senior Engineer to join our team. As a key member of our development team, you will be responsible for architecting and building robust, scalable software applications using Laravel and the TALL stack.About the Role:This role requires a highly skilled individual with expertise in...

  • Highly Skilled .NET Software Engineer Wanted

    6 days ago

    Surat, Gujarat, India beBeeSoftware Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior .NET Software Engineer PositionWe are seeking a highly skilled and experienced Senior .NET Software Engineer to join our team. As a key member of our development team, you will be responsible for designing and developing high-quality .NET applications using optimal and efficient technologies, frameworks, and patterns.Main Responsibilities:Designing...

  • Highly Skilled Data Engineering Professional

    1 week ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Key Roles and ResponsibilitiesAt our organization, we are seeking a highly skilled Data Engineer with a strong background in data processing, machine learning, and software development.The ideal candidate will have experience designing and implementing Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools to...

  • Highly Skilled Database Engineer

    5 days ago

    Surat, Gujarat, India beBeeDatabase Full time ₹ 18,00,000 - ₹ 25,00,000

    Highly Skilled Database EngineerAbout the Opportunity:We are seeking a highly skilled database engineer with expertise in Azure data platform to join our growing data organization.Design, develop and optimize database solutions using T-SQL queries, stored procedures, views and functions to support data processing and reporting.Implement ETL/ELT pipelines...

  • Highly Skilled Data Validation Specialist

    11 hours ago

    Surat, Gujarat, India beBeeDataTesting Full time ₹ 8,00,000 - ₹ 12,00,000

    Senior Data Testing EngineerWe are seeking a skilled and detail-oriented individual to join our data engineering team as a Senior Data Testing Engineer.The ideal candidate will have strong experience in Python, Pandas, REST API, and testing, with a solid understanding of data validation, data processing, and software development methodologies.Key...

  • Senior Data Engineer

    9 hours ago

    Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to lead our data engineering projects. This is an exciting opportunity for a talented professional to design, develop, and deploy scalable data pipelines and ETL processes using Databricks.The ideal candidate will have:6+ years of experience in development and maintenance in data...

  • Highly Skilled Data Scientist

    11 hours ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,07,00,000 - ₹ 2,61,20,000

    Job Title: Azure Data EngineerAs a highly skilled and innovative data engineer, you will drive the research design and prototyping of AI-based solutions that push the boundaries of industrial applications, digital twins, and autonomous systems.You will lead and contribute to applied research in Generative AI, including LLMs, Vision-Language Models, VLMs,...