Data Engineer with Python

2 weeks ago


Delhi, Delhi, India Unison Consulting Pte Ltd Full time
Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.
Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.
Optimize and troubleshoot AWS Glue jobs for performance and reliability.
Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process.
Design and implement scalable data processing solutions using PySpark to transform raw data into a structured and usable format.
Apply data cleansing, enrichment, and validation techniques to ensure data quality and accuracy.
Create and maintain ETL processes using Python and PySpark to move and transform data between different systems.
Optimize ETL workflows for performance and efficiency.
Collaborate with data architects to design and implement data models that support business requirements.
Ensure data structures are optimized for analytics and reporting.
Work with distributed computing frameworks, such as Apache Spark, to process and analyze large-scale datasets.
Manage and optimize databases, both SQL and NoSQL, to support data storage and retrieval needs.
Implement indexing, partitioning, and other database optimization techniques.
Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.
Work closely with software engineers to integrate data solutions into larger applications.

Implement monitoring solutions to track data pipeline performance and proactively identify and address issuesEnsure compliance with data privacy regulations and company policies.

Stay abreast of industry trends and advancements in data engineering, Python, and PySpark.
RequirementsProficiency in Python and PySpark.
Strong knowledge of data engineering concepts and best practices.
Hands-on experience with AWS Glue and other AWS services.
Experience with big data technologies and distributed computing.
Familiarity with database management systems (SQL and NoSQL).Understanding of ETL processes and data modeling.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Bachelor's degree in Computer Science, Information Technology, or a related field.

  • Delhi, Delhi, India Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Full time

    Greetings from Teamware Solutions! Join Our Team! We are looking for a **GCP Data Engineering with Python**. Job Title: GCP Data Engineering with PythonJob Type: Full-Time (Hybrid)Job Location: Hyderabad/Bangalore/Mumbai/KolkataExperience: 4+ YearsNotice Period: Immediate to 15 daysJob Description:- Solid experience in Data Flow- Proficiency in Python...


  • Delhi, Delhi, India Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Full time

    Greetings from Teamware Solutions. . Join Our Team. .. #MNC HiringWe are hiring GCP Data Engineering with Python. .Job Title:GCP Data Engineering with PythonJob Type: Full-Time (Hybrid)Job Location: Hyderabad/Bangalore/Mumbai/KolkataExperience: 4+ YearsNotice Period: Immediate to 15 daysJob Description:solid experience in Data have worked on Python...

  • Sr. Python Engineer

    2 weeks ago


    Delhi, Delhi, India MakroTech Full time

    Job DescriptionDesign, develop, and refine at least one Python framework, such as Django, Flask, or Pyramid.Collaborate with scrum master, product teams, and data engineer to ensure Python framework alignment with Human Resource goals and user needs.Able to understand front-end technologies, like JavaScript and HTML, as part of their duties includes...


  • Delhi, Delhi, India CredHive Full time

    Position OverviewWe are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...


  • Delhi, Delhi, India CredHive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...


  • Delhi, Delhi, India Credhive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry.Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...


  • Delhi, Delhi, India Tech Mahindra Full time

    Duration:Long TermWorking Hours : 2pm to 11pm ISTBand : U3 or U4Working Location : Remote - PAN INDIA (preferably near to Tech M office)Experience : 6-12 YearsKey words to search for the candidate.Mandatory –Python, Airflow, SQL, Data ModellingGood to have but not mandatory– Healthcare Domain experience, Snowflake.Certifications (Good to have) –NoneJob...


  • Delhi, Delhi, India Tech Mahindra Full time

    Duration:Long TermWorking Hours:2pm to 11pm ISTBand:U3 or U4Working Location:Remote - PAN INDIA (preferably near to Tech M office)Experience: 6-12 YearsKey words to search for the ideal candidate:Mandatory - Python, Airflow, SQL, Data ModellingGood to have but not mandatory - Healthcare Domain experience, SnowflakeCertifications (Good to have) - NoneJob...


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India CloudPSO Inc Full time

    Job DescriptionAs a Data Engineer specializing in Python, SQL, and Power BI, you will be responsible for designing, developing, and maintaining data pipelines and architectures. You will collaborate with data scientists and analysts to ensure the efficient flow and processing of data, enabling data-driven decision-making across the organization. This role is...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India OnebyZero Pte Ltd. Full time

    Job DescriptionThe ability to design, implement, and optimize large-scale data and analytics solutions,Implementing ETL pipelines within and outside of a data warehouse using Python.Performing DML and DDL on CloudDevelopment of scripts using Python for loading, extracting, and transforming data.Assist with production issues in data warehouses like loading...


  • Delhi, Delhi, India QuEST Global Services Pte. Ltd Full time

    Quest Global is an organization at the forefront of innovation and one of the world's fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.We are looking...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Cynosure Corporate Solutions Full time

    Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, youll create algorithms and conduct statistical analysis. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Cynosure Corporate Solutions Full time

    Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, youll create algorithms and conduct statistical analysis. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India OnebyZero Pte Ltd. Full time

    Job DescriptionThe ability to design, implement, and optimize large-scale data and analytics solutions,Implementing ETL pipelines within and outside of a data warehouse using Python.Performing DML and DDL on CloudDevelopment of scripts using Python for loading, extracting, and transforming data.Assist with production issues in data warehouses like loading...

  • Data Engineer –

    2 weeks ago


    Delhi, Delhi, India HARMAN International Full time

    HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India CloudPSO Inc Full time

    Job DescriptionAs a Data Engineer specializing in Python, SQL, and Power BI, you will be responsible for designing, developing, and maintaining data pipelines and architectures. You will collaborate with data scientists and analysts to ensure the efficient flow and processing of data, enabling data-driven decision-making across the organization. This role is...