Senior Big Data Engineer

1 week ago


India QntmLogic, LLC. Full time
Job Description

We are seeking a highly skilled Senior Python Developer for our Big Data development team at QntmLogic, LLC. in Bangalore/Pune (Hybrid). The ideal candidate will have hands-on experience with PySpark, Hadoop, Tableau, and SQL Server development.

The successful candidate will be responsible for designing and building big data solutions using industry-standard technologies such as ETL development, CI/CD pipelines, and DevOps principles. They will also work closely with the team to create solutions that follow industry-standard usability, performance, reliability, and scalability.

We require candidates with excellent technical skills in Python, PySpark, ETL, HDFS, SQL, CICD on AWS, and Airflow on Prem. Experience in API development (data ingestion using APIs) is also desirable.

This role involves working with a dynamic team to design, build, and deploy big data solutions. We are looking for someone with strong problem-solving skills, who can think critically and creatively.

Requirements
  • 6+ years of experience in big data development
  • Strong knowledge of PySpark, Hadoop, Tableau, and SQL Server
  • Experience with CI/CD pipelines and DevOps principles
  • Excellent technical skills in Python, PySpark, ETL, HDFS, SQL, CICD on AWS, and Airflow on Prem
What We Offer

We offer a competitive salary package to the right candidate, estimated at ₹25-35 lakhs per annum based on experience and qualifications.



  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...


  • India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...


  • Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full time

    Job Title: Senior Big Data EngineerJob Summary:US Technology International Pvt Ltd is seeking a Senior Big Data Engineer to lead the development and implementation of big data solutions. The ideal candidate will have expertise in Hadoop, Spark, and other big data technologies, as well as strong leadership and communication skills.Key Responsibilities:Design,...


  • India Atyeti Inc Full time

    At Atyeti Inc, we are seeking a highly skilled Senior Big Data Architect to join our team. In this role, you will be responsible for analyzing and processing large datasets using big data technologies and programming languages such as Scala and Java.About the JobThe ideal candidate should have at least 6 years of experience in high-tech industry and/or IT...

  • Big Data Engineer

    1 month ago


    India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...


  • India IGT Full time

    Job DescriptionExciting opportunity for a Senior Big Data Engineer to design, develop, and maintain scalable data pipelines using Python and PySpark.Key Responsibilities:Design and implement efficient data architectures using AWS services such as S3, Glue, Lambda, and Athena.Work with SQL and MongoDB to manage and query large datasets, ensuring data quality...


  • India Maestro Technologies, Inc. Full time

    About the RoleMaestro Technologies, Inc. is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale data processing pipelines using big data technologies such as Apache Spark and Hadoop.Key ResponsibilitiesDesign and implement...


  • india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.


  • Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    About the RoleWe are seeking an experienced Senior Big Data Engineer for Cloud Migration to join our team at D-TechWorks Pvt Ltd.Job SummaryThe ideal candidate will have 7-9 years of experience in leading big data engineering projects using AWS, Azure, or GCP. They should be proficient in BigData Python, PySpark, AWS Glue, Airflow, and Redshift.Key...


  • India NEXUS CONSULTING SOLUTIONS Full time

    Nexus Consulting Solutions seeks an experienced Big Data Systems Engineer to join our team. This is a challenging and rewarding role that requires expertise in designing, developing, and maintaining large-scale big data systems.We are looking for someone with hands-on experience in Python and Scala programming languages. Familiarity with the Spark framework,...


  • India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...


  • India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.

  • Big Data Developer

    2 weeks ago


    India Luxoft Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a key member of our Data Engineering & Analytics team, you will play a crucial role in developing data-driven solutions that drive business growth.About the RoleThis is an exciting opportunity for a seasoned data engineer to leverage their...


  • Anywhere in India/Multiple Locations Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Big Data Developer

    2 weeks ago


    India Luxoft Full time

    Project Description: As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...

  • Big Data Developer

    2 weeks ago


    India Luxoft Full time

    Project Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...


  • India Radioactive Technologies Full time

    At Radioactive Technologies, we're on the hunt for a skilled Energetic Big Data Engineer to join our team. The salary for this role is around $140,000 per year.We're looking for someone with 10 years of experience in data transformation and aggregation using Scala/Spark jobs. As a Full Time Contract Opportunity, you'll have the chance to work fully...

  • Big Data Developer

    2 weeks ago


    India Impetus Full time

    Lead Software Engineer Locations- Indore, Noida, Hyderabad Job Description We are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles & Responsibilities Key Responsibilities ...