Data Architect and Engineer: Lead Big Data Projects

4 days ago

Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Data Engineer Job Description

This senior data engineer position is responsible for designing, developing, and maintaining large-scale data processing systems. The successful candidate will have a strong technical background in cloud-based technologies, big data processing, and data warehousing.

The role requires the ability to collaborate with cross-functional teams, including software engineers, data scientists, and product managers, to deliver high-quality solutions that meet business requirements.

  • Design and implement scalable data pipelines using cloud-based services such as AWS Lambda and Apache Airflow.
  • Develop and maintain complex ETL workflows comprising SCD, deduplications, aggregations etc., utilizing tools like Apache Beam or Spark.
  • Collaborate with data architects to design and implement database schema, ensuring optimal performance and scalability.
  • Work closely with data engineers to ensure smooth operation of data processing systems, identify bottlenecks, and implement improvements.
Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree is a plus).
  • Minimum 7-9 years of IT experience, with at least 5 years of experience on Cloud-related projects.
  • Excellent knowledge of AWS Services, including S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions, Aurora, Singlestore, RedShift, Snowflake, Hadoop, Hive, Spark, YARN, Scala, Python, Shell Scripts, PySpark, Linux, Windows, and SQL.
  • Associate Level and Professional Level AWS Certification a plus.
  • Strong understanding of orchestration tools, such as Apache Airflow, and expertise in developing ETL workflows.
Benefits

This role offers a competitive salary package, opportunities for career growth and professional development, and a dynamic work environment.

Others

The ideal candidate will be a quick learner, self-motivated, and focused on delivering outcomes for a fast-growing team and firm. Prior experience working in a large media company would be an added advantage.

  • Big Data Architect

    1 hour ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled and experienced data architect to lead the design, development and implementation of our big data pipelines. The ideal candidate will have a proven track record in building scalable and efficient data systems, with hands-on experience in distributed data processing technologies such as Scala, Spark and...

  • Big Data Solutions Architect

    2 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 10,80,000 - ₹ 20,16,000

    Big Data Solutions ArchitectWe are seeking an experienced Big Data Solutions Architect to drive the design and implementation of large-scale data processing systems.Key Responsibilities:Develop and implement big data solutions using various tools and technologies, including programming languages such as Java and Scala, frameworks like Apache Spark, and data...

  • Lead Data Architect

    22 hours ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to lead our data warehousing and data modeling efforts. The successful candidate will have a strong understanding of data engineering principles and experience with distributed computing.Main Responsibilities:Select and integrate big data tools and frameworks to provide...

  • Lead Big Data Engineer

    4 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 24,00,000

    Senior Data Engineer PositionWe are seeking a seasoned Senior Data Engineer to join our team.The ideal candidate will have 5+ years of experience in data engineering and a strong background in working with big data technologies such as Azure/AWS Databricks, Python/Scala/Spark/Pyspark, HIVE/HBase/Impala/Parquet, and SQL/RDBMS. Additionally, experience with...

  • Big Data Platform Engineer

    1 week ago

    Meerut, Uttar Pradesh, India beBeetechnicallead Full time ₹ 18,50,000 - ₹ 23,50,000

    We are seeking a highly skilled Technical Lead to join our team. The successful candidate will be responsible for building a scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.Responsibilities:Align with key client initiativesInterface daily with...

  • Big Data Project Manager

    4 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Opportunity">We are currently hiring for a skilled professional to work on Big Data projects.The ideal candidate will have 6–12 years of experience in Bigdata and related technologies.Key skills include:More than 5.8 Yrs of experience in Big Data projects.Experience in Big Data technologies including PySpark/Scala Spark/Java Spark SQL.A good...

  • Senior Data Architect

    2 days ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ArchitectThe role of Senior Data Engineer will be pivotal in crafting scalable data pipelines on cloud platforms. The ideal candidate will possess exceptional programming skills in Python and/or Scala, as well as hands-on experience with Apache Spark for big data processing on AWS.This position encompasses the design and implementation of data...

  • Senior Big Data Architect

    1 week ago

    Meerut, Uttar Pradesh, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 30,00,000

    Lead Databricks EngineerAbout the Role:We are seeking a highly skilled Lead Databricks Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes on Databricks.The successful candidate will have a proven track record of leading...

  • Chief Data Engineer

    2 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 2,00,62,500 - ₹ 2,51,12,500

    Job ProfileThis role requires an expert in data engineering to design and implement large-scale projects within our Enterprise Data Solutions division.You will be responsible for leading data engineering, integration, and warehousing projects from inception to delivery.Key ResponsibilitiesOversee the development of complex data architectures and integrations...

  • Senior Big Data Solutions Architect

    4 days ago

    Meerut, Uttar Pradesh, India beBeeDataEngineering Full time US$ 1,00,000 - US$ 1,25,000

    Job OverviewWe are seeking an experienced Data Engineering Leader to join our team.This role is ideal for a seasoned professional with a passion for data-driven solutions and leadership skills to mentor a small team of engineers.About the JobThis is a hands-on leadership position that requires a strong foundation in SQL and databases, coupled with working...