Data Engineer

6 days ago


Anywhere in IndiaMultiple Locations, IN Optivalue tek consulting Full time

Job Description :


As an agile data engineer & software developer, need to work together with business users and members of the development team to provide quality systems that improve productivity, decrease operational risk, enable the business to expand and make users smile. These are high profile applications that offer you the opportunity to craft the future technical direction and take ownership for functional components

Roles & Responsibilities :


- Design, build, and maintain scalable data pipelines and infrastructure using Python and Java.

- Ensure data quality and integrity by implementing data validation and testing frameworks.

- Collaborate with cross-functional teams to understand business requirements and design data solutions that meet those requirements.

- Optimize data pipelines and infrastructure for performance and scalability, utilizing Kubernetes for container orchestration.

Professional & Technical Skills :


- Experience of 8-12 years working in Big data, Java/Python/Spark for implementing projects with high SLA of data availability and data quality, exposure to Cloud technologies (Azure preferred) is a major plus.

- 4+ years of strong delivery experience in Impala, Hive, Hadoop, Pyspark.

- Experience using DevOps toolsets like GitLab, Jenkins, TDD/BDD tools like PyTest , Cucumber.

- Hands-on experience working with build tools like Maven/Gradle.


- Experience of working on Kubernetes / OpenShift, Containerization (Docker, Podman or Similar), Cloud Native technologies and frameworks (e.g. Spring Boot).

- Experience working in any cloud platform and preferably in Azure development including Databricks , AzureServices , ADLS would be a major plus.

- A real passion for and experience of Agile working practices, with a strong desire to work with baked in quality subject areas such as TDD, BDD, test automation and DevOps principles

- Be a part of a Software Engineering Chapter, working on deliverable for F1 big data platform & Unifi Gateway application using Java, Python, Spark, Impala, Hive, Hadoop, etc.

- Looking for a hands-on programmer with big data and Java/Python/Spark skills, who can help us build & maintain ambitious software / application .

- Partner and collaborate with Business Analysts, Developers and Testers to deliver working and robust solutions in a dynamic environment.


- Analyze business requirements, design implementable technical solutions that leverage process and development best practices.


Additional Information :


- The candidate should have a minimum of 8 years of experience in Data Engineering.

- The ideal candidate will possess a strong educational background in computer science, software engineering, or a related field, along with a proven track record of delivering impactful data-driven solutions.

- A strong team player who takes and drives initiative

- Organized, well-structured and with drive to deliver high quality software solutions / components

- Proactive, comfortable working in dynamic environments with fast-paced deliveries and changing requirements

- This position is based at our Pune office.

- Should be ready to work from Client office 3 days a week

(ref:hirist.tech)
  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data ArchitectExperience Required : 10yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description : 10+ years of proven experience as a Data Engineer with 5+ years as Data Architect.- Bachelor's degree in computer science, Information...

  • Senior Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior/Staff Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Lead Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Pro5.ai Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ARAHAS TECHNOLOGIES PRIVATE LIMITED Full time

    We are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description :- The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow- Experience working with complex SQL queries- Good with PySpark, Databricks, and Airflow- Bachelor's or Master's degree in...


  • Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...


  • Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • Data Engineer

    7 days ago


    Anywhere in India/Multiple Locations, IN Gama Advisory Services LLP Full time

    Overview :We are looking for a highly skilled Data Engineer with extensive experience in ETL (Extract, Transform, Load) processes and PySpark to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines that support data transformation and processing needs. Your expertise in PySpark and...


  • Anywhere in India/Multiple Locations, IN Zyoin group Full time

    We're seeking a talented and experienced Data Platform Engineer to join our team and play a key role in optimizing, maintaining, and evolving our data infrastructure. You'll be responsible for ensuring our data pipelines run smoothly, efficiently, and cost-effectively, while contributing to a stable and exceptional user Pipeline Powerhouse:...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full time

    Responsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...


  • Anywhere in India/Multiple Locations, IN Softtech Career Infosystem Pvt. Ltd. Full time

    Job Description :- Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm- Integrating technical functionality, ensuring data accessibility, accuracy, and security.- Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks...


  • Anywhere in India/Multiple Locations, IN QUARKS TECHNOSOFT PRIVATE LIMITED Full time

    Job Title : Senior Data EngineerExperience - 6+ Years Job Overview :We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the cloud. The Senior Data Engineer will work closely with cross-functional teams to...

  • Senior Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Aventior Digital Private Limited Full time

    Designation : Senior Data EngineerPreferred Experience : 7+ years of :- Collaborate with the Data Migrations Technical Project Manager to plan, execute, and track data migrations projects.- Work to establish yourself as the Data Migrations Team "go-to" technical lead. Help coordinate and facilitate work across the Data Migrations Team - enabling and ensuring...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN AAR Consultancy Full time

    Technical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...