Big Data and Analytics Lead

2 days ago


Anywhere in IndiaMultiple Locations Cybyrotek Solutions Full time
Job Title: Senior Data Engineer

About Cybyrotek Solutions: We are a leading technology company that provides innovative data engineering solutions to its clients.

The Job: We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining large-scale data pipelines and architectures.

Your Key Responsibilities:

  • Data Engineering: Develop and maintain complex data pipelines and architectures using Python, shell scripting, and ETL tools like Informatica Cloud.
  • SQL and Data Querying: Write efficient SQL queries to extract insights from complex datasets and create custom checks to monitor services.
  • Data Pipeline Management: Manage and monitor data pipelines in various environments, including upstream, batch, and streaming, and use pipeline orchestration tools like Luigi or Airflow.
  • Operational Support and Troubleshooting: Provide operational support, including troubleshooting and resolving incidents, and ensure high availability of data services.
  • Cloud Platforms and Data Environments: Work with cloud platforms like AWS, GCP, or Azure and experience with OpenShift and Kubernetes environments.
  • Monitoring and Automation Tools: Use Prometheus, Grafana, or similar tools to monitor service health and set up monitoring dashboards.
  • Security and Access Management: Ensure proper user access management, including account setup and permissions validation.
  • Data Flow and System Dependencies: Understand and document data flows and dependencies between different data services.
  • DevOps and Agile Practices: Collaborate with cross-functional teams using DevOps principles and Agile methodologies.

Requirements: To succeed in this role, you should have a strong foundation in programming languages, ETL tools, SQL, and data pipeline management, as well as experience with cloud platforms, monitoring and automation tools, and security and access management.

What We Offer: As a Senior Data Engineer at Cybyrotek Solutions, you will have opportunities to grow your skills, work on challenging projects, and contribute to the success of our organization.



  • Anywhere in India/Multiple Locations AJ Consulting Full time

    Job DescriptionWe are looking for a highly experienced Big Data Solutions Lead to join our team at AJ Consulting. In this role, you will be responsible for designing and implementing scalable and robust data pipelines using PySpark.You will also ensure data accuracy and integrity by implementing data validation and quality checks, and mentor and coach team...

  • Big Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    Responsibilities :- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.- Perform data analysis, transformation, and cleansing to extract valuable insights.- Optimize performance and scalability of big data applications.- Collaborate with data scientists and analysts to understand data requirements and...

  • Big Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...


  • Anywhere in India/Multiple Locations AJ Consulting Full time

    About the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...

  • Big Data Developer

    2 weeks ago


    Anywhere in India/Multiple Locations Populace World Solution Full time

    Job Description : - Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. - Proficient in using Spark/Scala - Experience with data Import/Export using Sqoop or similar tools - Experience using Airflow, Jenkins or similar other automation tools - Excellent knowledge of SQL Server and database...


  • Anywhere in India/Multiple Locations AEONOVATECH PRIVATE LIMITED Full time

    Key Responsibilities :- Lead and mentor a team of Big Data Engineers.- Participate in the design and implementation of the big data analytics architecture on Azure.- Develop and implement big data pipelines using Spark Scala and Python.- Write complex Hive queries to extract valuable insights from data lakes.- Collaborate with cross-functional teams (QA,...


  • Anywhere in India/Multiple Locations TEG Analytics Full time

    Job Description :Explainable Artificial Intelligence is an approach to building AI systems that can provide clear explanations for their decisions and actions. It aims to increase transparency and trust in AI by enabling humans to understand how AI algorithms arrive at their choices. This is especially important in healthcare, where AI systems are...


  • Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full time

    About the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...

  • Engineering Lead

    7 days ago


    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    We are seeking an experienced Engineering Lead - Data Processing to lead our efforts in building and maintaining cutting-edge big data processing systems. As a key member of our engineering team, you will be responsible for overseeing the design, implementation, and maintenance of our big data infrastructure, ensuring seamless integration with existing...


  • India HCLTech Full time

    Job Description:HCLTech is seeking a highly skilled Big Data Analytics Architect to lead the design, development, and maintenance of scalable and robust data pipelines. About Us:HCLTech is a global technology company that enables digital transformation for enterprises and society.Key Responsibilities:Design and develop big data analytics solutions using...


  • Anywhere in India/Multiple Locations Valiance Analytics Pvt. Ltd. Full time

    About Valiance Analytics Pvt. Ltd.We're a global AI & Data analytics firm dedicated to helping clients succeed in the digital age.Our team of 100+ experts in Machine Learning, Data Engineering, and Cloud expertise has delivered transformative solutions for top brands across industries.We're seeking a seasoned Data Science Engineer with expertise in Python,...


  • Anywhere in India/Multiple Locations TEG Analytics Full time

    Join us at TEG Analytics where we're dedicated to developing innovative healthcare solutions. As our Product Analytics Lead, you'll play a pivotal role in shaping the future of health insurance products for Medicare Advantage. Our mission is to create cost-effective plans tailored to individual needs, ensuring optimal patient care at affordable prices.About...


  • Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...


  • Remote/Anywhere in India/Multiple Locations DXC Luxoft Full time

    Project Description : We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products. Responsibilities : - Choosing the right technologies for our use cases, deploy and operate. - Setting up...


  • Anywhere in India/Multiple Locations TEG Analytics Full time

    We're on a mission to develop cutting-edge solutions for designing health insurance products at TEG Analytics. As our Product Analytics Lead, you'll work closely with the Product Manager to shape the next generation of healthcare solutions for Payers in the Medicare Advantage ecosystem. Our commitment lies in improving the health of beneficiaries, fueled by...

  • Lead Data Engineer

    12 hours ago


    Anywhere in India/Multiple Locations Zenfinet Full time

    Job OverviewZenfinet is seeking a skilled Databricks Developer to join our team. As a key member, you will be responsible for designing and implementing cutting-edge data engineering solutions using Databricks.About the RoleThis is an exciting opportunity for a motivated professional with experience in data engineering, cloud computing, and big data...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Job DescriptionAs an Enterprise Analytics Lead at RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED, you will be responsible for leading the development and implementation of data-driven solutions that drive business growth. This includes designing and implementing advanced analytics and AI/ML-driven insights, as well as integrating multiple data sources and...

  • Big Data Engineer

    4 days ago


    Remote/Anywhere in India/Multiple Locations Upraised Full time

    At Upraised, we are seeking a highly skilled Data Warehouse Architect to lead the design and development of our robust data infrastructure.This critical role is responsible for creating efficient data models and schema designs that support business intelligence and analytics needs. The ideal candidate will have hands-on experience in building, optimizing,...


  • Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full time

    About the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...

  • Technical Lead

    6 days ago


    Anywhere in India/Multiple Locations Genpact Full time

    Data Engineer Role:You'll be responsible for designing, developing, and maintaining large-scale data systems, as well as collaborating with cross-functional teams to implement data-driven solutions.This role requires strong technical skills, a passion for innovation, and a commitment to delivering high-quality results.