Big Data Architect

17 hours ago


Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000
Senior Big Data Engineer

We are seeking an experienced Senior Big Data Engineer to build and maintain robust data pipelines, design scalable data lakes, and collaborate with cross-functional teams.

Key Responsibilities
  • Design and implement large-scale ETL pipelines using PySpark and AWS Glue to process high-volume datasets.
  • Collaborate with analysts, stakeholders, and engineers to ensure data quality, availability, and integrity.
  • Write and optimize complex SQL queries for efficient data transformation and analysis.
  • Utilize Git for version control and code collaboration.
  • Develop and manage scalable data lakes using AWS S3 and related services.
  • Work with Amazon DynamoDB and Redshift for high-performance data storage and querying.
  • Create interactive dashboards using Amazon QuickSight to visualize key performance indicators.
  • Automate workflows with AWS Step Functions, Lambda, and EventBridge.
Requirements
  • Bachelor's degree in Computer Science, Data Science, or a related field (Master's preferred).
  • Strong hands-on experience with PySpark, Python, and SQL.
  • Proficient in Git and AWS services (Glue, S3, Lambda, Redshift, Athena, DynamoDB, etc.).
  • Familiarity with Databricks and its ecosystem.
  • Excellent problem-solving and communication skills.
  • Ability to thrive in a fast-paced, collaborative environment.


  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 20,10,000

    Cloud Data ArchitectJob Description:We are seeking a highly skilled Cloud Data Architect to join our team. The ideal candidate will have a strong focus on Big Data management and data quality skills, with expertise in Azure Cloud.Hands-on experience in Azure for a minimum of 3–4 years, with overall professional experience of less than 10 years.Proficient...


  • Lucknow, Uttar Pradesh, India beBeeData Full time US$ 1,49,999 - US$ 2,49,999

    Big Data Engineering ExpertJob Overview:We are seeking an experienced Big Data Engineer to lead our data engineering teams. As a key member of our organization, you will be responsible for designing and implementing scalable data pipelines using Scala and Python.Key Responsibilities:Manage cross-team collaboration with architects, product managers, and...


  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Solutions ArchitectWe are seeking a highly skilled professional to design and implement end-to-end big data solutions.The ideal candidate will have 5-12 years of experience in Big Data & related technologies, with expertise in distributed computing principles and Apache Spark.Main Responsibilities:Designing and implementing scalable big data...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced Data Architect to design and optimize our distributed data pipelines, infrastructure, and tools that power business insights. As a key member of our growing data team, you will collaborate closely with developers, architects, analysts, and data scientists to ensure smooth, secure, and efficient data delivery across...


  • Lucknow, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering LeaderJob Description:Our organization is seeking a seasoned Cloud Data Engineering Leader to lead the development of large-scale distributed data systems using Microsoft Azure and Databricks.Lead and grow a team of data engineers working on complex data solutions.Architect and oversee the development of end-to-end data solutions using...


  • Lucknow, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 24,00,000

    Big Data Specialist PositionWe are seeking a seasoned Big Data specialist to fill this key role. The ideal candidate will have a strong background in programming languages, particularly Java and Scala, with hands-on experience in developing big data applications using Apache Spark Frameworks and Unix Shell scripting.Key Responsibilities:Develop high-quality...

  • Senior Data Architect

    16 hours ago


    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Big Data Engineer OpportunityWe are seeking a highly skilled engineer with expertise in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation.Key Responsibilities:Design, develop, and optimize Big Data...

  • Big Data Specialist

    4 days ago


    Lucknow, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:The ideal candidate will design, develop and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Develop scalable data pipelines to integrate various data sources.Implement data validation and error handling mechanisms to ensure data quality and integrity.Collaborate with cross-functional teams to...


  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to lead the design, development, and implementation of scalable data processing solutions using big data technologies.The ideal candidate will have 6-12 years of experience in big data engineering and a proven track record of delivering high-quality solutions on time. They...

  • Big Data Specialist

    7 days ago


    Lucknow, Uttar Pradesh, India beBeeDataProcessing Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleAs a Data Processing Specialist, you will be responsible for building and managing big data clusters to ensure efficient data processing and storage. Your role will involve migrating data, performing performance tuning, and providing pre- and post-platform support for application migration. Proficiency in Linux commands is mandatory.In this...