Python Data Engineer

3 weeks ago


india Juego Studios Full time

As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the stability and functionality of our data pipelines. This role offers an exciting opportunity to work with cutting-edge technologies and make a significant impact on our data engineering processes.

Responsibilities:

  • Analyze and organize raw data to meet business needs and objectives.
  • Develop test and data validation frameworks using Python to ensure the quality and accuracy of data products.
  • Manage data, metadata, and pipeline stability to maintain a robust data infrastructure.
  • Collaborate with stakeholders including Product, Data, and Design teams to address data-related technical issues and support their data engineering needs.
  • Perform root cause analysis of existing models and propose effective solutions for improvement.
  • Utilize Git VCS for version control and collaboration on codebase.
  • Work with data pipeline and workflow management tools like Airflow to streamline data processes.
  • Demonstrate strong time management skills, effectively multitasking and thriving under pressure.
  • Foster a collaborative environment as a team player with strong interpersonal skills.

What We're Looking For In Our Applicants

  • Between 5 and 8 years of experience in similar roles, ideally in the banking industry.
  • Proficient in writing complex SQL queries for data analysis and manipulation.
  • Familiarity with Python libraries used for testing and ensuring data quality.
  • Working experience with cloud computing architecture, leveraging platforms such as AWS or Azure.
  • Proficiency in Python programming.
  • Hands-on experience with DevOps practices using GitHub or AzureDevOps (experience with AzureDevOps will be a plus).
  • Experience with data pipeline and workflow management tools like Airflow.
  • Ability to perform root cause analysis of existing models and propose effective solutions.
  • Strong time management skills, with the ability to efficiently multitask and work under pressure.
  • A team player with strong interpersonal skills, capable of collaborating effectively with cross-functional teams.
  • has context menuParagraph


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Data Engineer

    6 days ago


    India Unison Consulting Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered)...

  • Data Engineer

    6 days ago


    india Unison Consulting Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered) ...

  • Data Engineer

    2 months ago


    india Unison Consulting Pte Ltd Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field. At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases. At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...


  • India Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...


  • india Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale Optimize and troubleshoot AWS Glue jobs for performance and reliability Utilize Python and PySpark to efficiently handle large volumes of data...


  • india Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large...

  • Data Engineer

    1 month ago


    india Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    2 months ago


    india Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Data Engineer

    11 hours ago


    india Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • AWS Data Engineer

    2 months ago


    india Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...

  • Data Engineer –

    1 month ago


    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer

    6 days ago


    india Acesoft Labs (India) Pvt Ltd Full time

    Responsibilities :- Build extremely efficient and reliable data pipelines for training examples generation and real-time online training, etc.- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)- Design and implement reliable, scalable, robust, and extensible big...

  • Data Engineer

    4 weeks ago


    india Teksands.ai Full time

    The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and...


  • india K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures, we want...

  • Data Engineer

    2 months ago


    Anywhere in India,Multiple Locations SKEP IT SYSTEMS Full time

    Job Description : We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...

  • Senior Data Engineer

    2 weeks ago


    india Rigel Networks Pvt.Ltd Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Data Engineer

    1 week ago


    india CloudPSO Inc Full time

    Job Description As a Data Engineer specializing in Python, SQL, and Power BI, you will be responsible for designing, developing, and maintaining data pipelines and architectures. You will collaborate with data scientists and analysts to ensure the efficient flow and processing of data, enabling data-driven decision-making across the organization. This role...