Chief Big Data Engineer

23 hours ago

Bareilly, Uttar Pradesh, India beBeeCloudDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

Job Description:

">
  • ">
  • We are seeking a seasoned Big Data Architect with expertise in designing, developing and implementing large-scale data engineering solutions leveraging AWS services.">
">

Key Responsibilities:

">
  1. ">
  2. Design and develop scalable Big Data architectures using AWS services for complex data processing.">
  3. Build and maintain data pipelines using Spark (Scala) for structured and unstructured datasets.">
  4. Architect and operationalize data engineering and analytics platforms on AWS, including EMR, Glue, Kinesis, DynamoDB, Athena and S3.">
  5. Implement real-time streaming solutions using Kafka and AWS Kinesis.">
  6. Support ML model deployment and management on AWS, including scheduling and monitoring.">
  7. Analyze source system data and ensure high-quality, reliable data delivery for business needs.">
  8. Write efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow and Kylo.">
  9. Collaborate with cross-functional teams to provide technical leadership and mentor team members.">
  10. Troubleshoot complex technical issues and ensure scalability, performance and security of data solutions.">
">

Mandatory Skills & Qualifications:

">
  • ">
  • Proven experience in Big Data Technologies (AWS, Scala, Hadoop and Spark).">
  • Expertise in Spark with Scala.">
  • Hands-on experience with AWS services, including EMR, Glue, Lambda, S3, CloudFormation, API Gateway and Athena.">
">

Benefits:

">

As a member of our team, you will have the opportunity to work on challenging projects, collaborate with experienced professionals and contribute to the growth and development of our organization.

">

Requirements:

">

To be successful in this role, you will need strong hands-on experience in Big Data Technologies, expertise in Spark with Scala and proficiency in AWS services.

">

What We Offer:

">

Competitive salary and benefits package, opportunities for career growth and professional development, and a collaborative work environment.

">

Keyword: CloudDataEngineer

  • Big Data Specialist

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Big Data SpecialistWe are seeking a highly skilled big data specialist to design, build, and maintain robust data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of cloud computing, programming languages like Python, and experience in handling data from various sources...

  • Senior Big Data Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeBigData Full time ₹ 19,44,000 - ₹ 25,20,000

    Job Title:Hadoop Big Data Ecosystem ProfessionalWe are seeking an experienced Hadoop Big Data Ecosystem Professional to take on a challenging role in designing and developing scalable data processing systems using the latest technologies in the Hadoop ecosystem.Key Responsibilities:• Hands-on experience of Scala, Spark, Hive, and other tools within the...

  • Highly Skilled Big Data Engineer Wanted

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Overview\Helpers are looking for a highly skilled engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.\

  • Leading Big Data Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity:A highly skilled and experienced data engineer is required to lead our big data engineering team.Must have 7-12 years of experience in managing distributed teams across multiple geographies and time zones.Proven ability to manage cross-team collaboration with architects, product managers, and operations.Familiarity with Scala and Python...

  • Senior Big Data Architect

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data Solutions ArchitectWe are seeking a highly skilled big data solutions architect with expertise in designing and implementing scalable, high-performance data pipelines.The ideal candidate will have strong knowledge of AWS cloud services, Databricks, and big data frameworks.Main Responsibilities:Design, develop, and maintain complex data pipelines...

  • Big Data Specialist

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking an accomplished big data developer to lead our team in delivering scalable data-driven solutions.The ideal candidate will have hands-on experience with Spark, Scala and PySpark, as well as a strong understanding of database systems.Key Responsibilities:Developing efficient big data solutions using data analytics...

  • Big Data Specialist

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Big Data Specialist Job DescriptionThis is a full-time role for an experienced specialist in data processing with one of our prominent clients.The specialist will be responsible for designing, deploying, and managing large-scale data processes to integrate information from various sources. Daily tasks include using ETL tools, performing data modeling,...

  • Big Data Expert

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:We are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience working with Azure Databricks and PySpark.The successful candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems using Azure Databricks and PySpark.Key Responsibilities:Design and develop...

  • Big Data Specialist

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data Specialist We are seeking an experienced data engineer to join our team. This individual will be responsible for designing, building, and maintaining large-scale data systems. The ideal candidate will have hands-on experience with distributed computing frameworks and a proven track record of delivering high-quality solutions. Key...

  • Chief Data Architect

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About Senior Data Engineer Role:Job Title: Senior Data EngineerWe are seeking an experienced professional to design, develop, and maintain large-scale data pipelines using big data technologies. The successful candidate will be responsible for creating efficient ETL pipelines utilizing big data technologies such as pySpark, Hadoop, and Hive.Key...