Data Engineer with Python

4 weeks ago


Delhi, India Unison Consulting Pte Ltd Full time
Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.Optimize and troubleshoot AWS Glue jobs for performance and reliability.Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process.Design and implement scalable data processing solutions using PySpark to transform raw data into a structured and usable format.Apply data cleansing, enrichment, and validation techniques to ensure data quality and accuracy.Create and maintain ETL processes using Python and PySpark to move and transform data between different systems.Optimize ETL workflows for performance and efficiency.Collaborate with data architects to design and implement data models that support business requirements.Ensure data structures are optimized for analytics and reporting.Work with distributed computing frameworks, such as Apache Spark, to process and analyze large-scale datasets.Manage and optimize databases, both SQL and NoSQL, to support data storage and retrieval needs.Implement indexing, partitioning, and other database optimization techniques.Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.Work closely with software engineers to integrate data solutions into larger applications.Implement monitoring solutions to track data pipeline performance and proactively identify and address issuesEnsure compliance with data privacy regulations and company policies.Stay abreast of industry trends and advancements in data engineering, Python, and PySpark.RequirementsProficiency in Python and PySpark.Strong knowledge of data engineering concepts and best practices.Hands-on experience with AWS Glue and other AWS services.Experience with big data technologies and distributed computing.Familiarity with database management systems (SQL and NoSQL).Understanding of ETL processes and data modeling.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Bachelor's degree in Computer Science, Information Technology, or a related field.



  • Delhi, India Juego Studios Full time

    As a Python Data Engineerfor Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the stability...


  • delhi, India Juego Studios Full time

    As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the...

  • Data Engineer

    4 weeks ago


    Delhi, India Unison Consulting Pte Ltd Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases.At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...


  • Delhi, India iScale Solutions Full time

    Job DescriptionCompany Overview:iScale Solutions specializes in providing top-tier software engineering talent to clients worldwide. We are currently seeking Python Software Engineers for a global marketing agency. The selected engineers will work as part of our team in Vietnam, with a close bond with the APAC regional team.Responsibilities:Develop and...


  • Delhi, India Nityo Infotech Full time

    16 hours ago **Job Code**: JD-19728 **JOB DESCRIPTION**: Job Title: Sr. Software Engineer - Python We are looking forward to hire Python Professionals in the following areas : Experience - 4-6 Years Job description - We are looking for a Python Developer to join our engineering team and help us develop and maintain various software products. - The...

  • Data Engineer –

    4 weeks ago


    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...


  • Delhi, India SA Technologies Full time

    Job DescriptionUnlock New Career Horizons with SA Technologies Inc.We're Hiring: Data Engineer in Mumbai/KolkataAt SA Technologies Inc., we believe in turning career aspirations into reality. As a Great Place to Work Certified company, recognized as one of the Best Places for Women, and a CMMI Level 5 Company, we are committed to creating a workplace that is...

  • Data Engineering

    2 days ago


    Delhi, India Info Origin Inc. Full time

    NEW OPPORTUNITY || CONTRACT TO HIRE ROLE FINANCIAL ANALYTICS DATA ENGINEER!!!Required Immediate to 30 days joiners only.- Position Title: Financial Analytics Data Engineer- Location: Bangalore/ Hyderabad- Position Type: Contract to hire roleRequired Experience:- 3+ years of experience- Experience with SQL, Visual Studio, UC4, SSIS, and SSRS (Microsoft Azure...


  • Delhi, India QuEST Global Services Pte. Ltd Full time

    Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.We are looking...

  • Senior Data Engineer

    3 weeks ago


    Delhi, India 3Pillar Global Full time

    We are 3PILLAR GLOBALWe build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset....


  • delhi, India Enterprise Minds, Inc Full time

    Hi Folks,Greetings from Enterprise Minds!!We're thrilled to announce an exciting opportunity to join our dynamic team at Enterprise Minds. We are on the lookout for a passionate and talented "UI UX Designer"About us:Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune, Tirupati,...

  • Data Engineer

    2 weeks ago


    Delhi NCR, India Dashhire Full time

    Responsibilities : - Database development experience of 3-5 years. - Understanding of database technologies like postgresql.- RDBMS integration knowledge like sqlite, sql, or postgres.- SQL query optimizations.- Analyze and organize raw data.- Work on automating the data tasks in python.- Work on existing data models and make continuous enhancements to...

  • Data Analist

    2 weeks ago


    Delhi, India Amstelbay Full time

    Job DescriptionEen van onze relaties biedt beleggingsfondsen voor particuliere en zakelijke beleggers. Ze willen hun bestaande klantenbase, bestaande uit duizenden vooral particuliere beleggers, proberen uit te breiden. Van hun bestaande klanten hebben ze NAW-gegevens en de beleggingstransacties. Hun doelgroep werven ze middels allerlei en vooral...

  • Data Engineer

    4 weeks ago


    Delhi, India TEKsystems Full time

    Job Description:We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines within the Snowflake data platform.Responsibilities:1. Snowflake Data Engineering:Design,...

  • Data Engineer

    4 days ago


    delhi, India HTD Resources Full time

    Skill: Data Engineer with Python knowledgeDesignation : Software EngineerRelevant Experience: 5 - 6 yearsMandatory Skills:Primary Skills - Python, SQL, AWS, DWH Concept, ELT,Secondary Skills - GCP, CDCLocation: Mumbai / KolkataMode: Work from OfficeInterview Rounds: 3-4 Rounds


  • Delhi, India iScale Solutions Full time

    Job DescriptionCompany Overview:iScale Solutions specializes in providing top-tier software engineering talent to clients worldwide. We are currently seeking Python Software Engineers for a global marketing agency. The selected engineers will work as part of our team in Vietnam, with a close bond with the APAC regional team.Responsibilities:Develop and...

  • Automation Engineer

    3 days ago


    delhi, India Tech Mahindra Full time

    Hiring SW/Python test automation engineer Sriperumbudur ChennaiResponsibilities• Develop, support and deploy test automation software and tools for our aircraft vehicles to manufacturing sites• Collect and analyze manufacturing data to debug hardware and software issues related to aircraft components/technologies and Linux systems• Support aircraft...

  • Data Engineer

    3 weeks ago


    Delhi, India OnebyZero Pte Ltd. Full time

    Job DescriptionThe ability to design, implement, and optimize large-scale data and analytics solutions,Implementing ETL pipelines within and outside of a data warehouse using Python.Performing DML and DDL on CloudDevelopment of scripts using Python for loading, extracting, and transforming data.Assist with production issues in data warehouses like loading...


  • Delhi, India QuEST Global Services Pte. Ltd Full time

    Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.We are looking...

  • Data Engineer

    7 days ago


    delhi, India EXL Full time

    Data EngineerLocation – Gurgaon, Noida, Pune, BangaloreCandidate should be highly comfortable with python (Libraries pandas, datetime, NumPy, config parser, sys, os, Json, requests, warnings)We don’t have any cloud-based solution, our whole framework is developed with Python functions which contains utility functions & python codes specific to...