Data Engineering Solutions Lead

1 day ago

Kanpur, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,24,65,100 - ₹ 2,09,43,900

IoT Data Solutions Architect

We are seeking a specialist with 5 to 7 years of experience in AWS IoT data engineering and strong Python skills to design and implement scalable IoT data architectures.

The ideal candidate will have hands-on experience in data transformation and data ingestion using GCP BQ Dataflow Airflow, and Python programming skills.

About the Role:

  • Design, develop, and deploy scalable IoT data pipelines using AWS services.
  • Write efficient, reusable, and maintainable Python code for data processing tasks.
  • Monitor and troubleshoot data ingestion and processing issues to maintain system reliability.
  • Collaborate with cross-functional teams to integrate IoT data with analytics and monitoring platforms.

About Our Team:

We work on large-scale IoT data ingestion, processing, and storage architectures. We stay updated with the latest AWS IoT and data engineering technologies and best practices.

Key Responsibilities:

  1. Ingest and process vast amounts of IoT data from various sources into our cloud-based architecture.

  2. Implement data transformation and aggregation using Big Data tools such as Apache Beam or AWS Glue.

  3. Develop high-performance data pipelines that can handle real-time and batch data processing workloads.

  4. Maintain and optimize existing data systems to ensure scalability, security, and reliability.

Bonus Points:

- Experience working with NoSQL databases such as DynamoDB or MongoDB - Knowledge of containerization using Docker or Kubernetes - Familiarity with DevOps tools like Jenkins or GitLab CI/CD - Proficiency in at least one machine learning framework such as TensorFlow or PyTorch

  • Data Engineer

    3 days ago

    Kanpur, Uttar Pradesh, India iXceed Solutions Full time

    Role - Data EngineerLocation - Chennai (Hybrid)Type - PermanentJob Description:Key Responsibilities:Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).Develop and maintain data processing workflows using PySpark and Python.Collaborate with data scientists, analysts, and business...

  • Data Engineering Lead

    2 weeks ago

    Kanpur, Uttar Pradesh, India beBeeDatabaseEngineering Full time ₹ 25,00,000 - ₹ 40,00,000

    We are seeking an experienced Data Engineering Lead to drive the development and implementation of our data infrastructure.Job DescriptionThe Data Engineering Lead will be responsible for designing, building, and maintaining scalable data systems that support our AI and ML initiatives. This includes:Designing and implementing database schemas, structures,...

  • Senior Data Engineering Lead

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced data engineer to lead the design and development of large-scale data processing systems that enable advanced analytics and business intelligence.As a senior data engineer, you will be responsible for architecting and implementing scalable and robust data pipelines that collect, process, and store large volumes of...

  • Lead Data Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Engineer - Scrum MasterAs a Lead Data Engineer and Scrum Master, you will be responsible for leading the development of data engineering projects using Scrum methodology.Responsibilities:Lead cross-functional teams in the development of data engineering projectsCollaborate with stakeholders to understand business requirements and develop...

  • Scalable Data Solutions Engineer

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeDataExtraction Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Extraction SpecialistThe ideal candidate will have deep technical knowledge in advanced web scraping techniques, reverse engineering, automation and leadership skills to drive the team towards success.Key Responsibilities:Design and develop scalable data extraction solutions using tools like Scrapy and Python libraries.Lead and mentor a team...

  • Data Engineering Solutions Architect

    8 hours ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a highly skilled Data Architect, you will be responsible for designing and building scalable data engineering solutions using modern Azure tools and best practices.This role requires a strong understanding of data lake architecture and modern data warehousing principles, as well as hands-on experience with Azure Data Factory (ADF), Azure Databricks, and...

  • Expert GCP Data Engineering Solutions Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer RoleWe are seeking a skilled and experienced data engineer to join our dynamic team.The ideal candidate will have expertise in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).This role involves collaborating with cross-functional teams to understand data requirements and translating them into...

  • Lead Data Solutions Developer

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data Engineer –Only IIT/NIT/VITAbout the Role:We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.This is a challenging opportunity for those who enjoy working with...

  • Leading Data Solutions Architect

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Key Roles and ResponsibilitiesOur organization is seeking a Data Engineer to join our team.The successful candidate will be responsible for designing, building, and maintaining large-scale data systems and architectures.Designing and implementing data pipelines to extract, transform, and load data from various sources.Developing and deploying software...

  • Senior Azure Stack Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 336844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN). Job Title: Senior Azure...