Data (Python) Engineer

2 weeks ago


india iScale Solutions Full time
Job Description

Company Overview:

iScale Solutions specializes in providing top-tier software engineering talent to clients worldwide. We are currently seeking Python Software Engineers for a global marketing agency. The selected engineers will work as part of our team in Vietnam, with a close bond with the APAC regional team.


Responsibilities:

  • Develop and maintain data pipelines to extract, transform, and load large datasets efficiently.
  • Utilize Python and related frameworks/libraries to build high-performance data processing applications.
  • Design and implement APIs using RestAPI to facilitate data access and integration.
  • Optimize and tune existing data pipelines for performance and scalability.
  • Work closely with DevOps teams to deploy and manage data applications using Docker and Kubernetes.
  • Conduct code reviews and provide mentorship to junior team members.
  • Stay updated with the latest trends and technologies in big data and data engineering.

Requirements
  • Proven experience in ETL projects, including data extraction, transformation, and loading.
  • Familiarity with Python frameworks like FastAPI, Flask, or Click is desired
  • Solid understanding of API development using RestAPI or similar frameworks
  • Experience in development under containerized environmen
  • Proven experience in designing and implementing multithreaded and multiprocessing applications
  • Proficiency in asynchronous programming paradigms and frameworks (asyncio
  • Experience with distributed systems and message-passing architectures (RabbitMQ, Redis, etc.
  • Strong understanding of concurrency concepts such as threads, processes, synchronization primitives, and parallelism.


Nice to have:

  • Familiarity with GraphQL is a plus.
  • Experience with GCP Services such as BigQuery, GCP Storage, and Bigtable is a plus.

Benefits
  • Competitive salary and benefits package.
  • Opportunity to work on a cutting-edge fintech project with a leading client.
  • Collaborative and dynamic work environment.
  • Professional development opportunities.

Requirements
At least 8 years of hands-on experience working on Java projects with leading experience will be a huge plus. Proficient in Java, preferably version 1.8, and SQL with a solid background. Mandatory experience with Spring Framework, Spring Boot, and React JS. Demonstrated DevOps mindset and practical experience. Exceptional analytical, deductive, and problem-solving abilities with meticulous attention to detail. Strong track record in writing comprehensive unit tests. Exposure to additional technologies such as containerization and designing reliable systems is advantageous. Being able to communicate in English is a must.

  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Data Engineer

    6 days ago


    India Unison Consulting Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered)...

  • Data Engineer

    6 days ago


    india Unison Consulting Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered) ...

  • Data Engineer

    2 months ago


    india Unison Consulting Pte Ltd Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field. At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases. At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...


  • India Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...


  • india Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale Optimize and troubleshoot AWS Glue jobs for performance and reliability Utilize Python and PySpark to efficiently handle large volumes of data...


  • india Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large...

  • Data Engineer

    1 month ago


    india Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    2 months ago


    india Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Data Engineer

    10 hours ago


    india Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • AWS Data Engineer

    2 months ago


    india Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...

  • Data Engineer –

    1 month ago


    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer

    6 days ago


    india Acesoft Labs (India) Pvt Ltd Full time

    Responsibilities :- Build extremely efficient and reliable data pipelines for training examples generation and real-time online training, etc.- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)- Design and implement reliable, scalable, robust, and extensible big...

  • Data Engineer

    4 weeks ago


    india Teksands.ai Full time

    The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and...


  • india K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures, we want...

  • Senior Data Engineer

    2 weeks ago


    india Rigel Networks Pvt.Ltd Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Data Engineer

    1 week ago


    india CloudPSO Inc Full time

    Job Description As a Data Engineer specializing in Python, SQL, and Power BI, you will be responsible for designing, developing, and maintaining data pipelines and architectures. You will collaborate with data scientists and analysts to ensure the efficient flow and processing of data, enabling data-driven decision-making across the organization. This role...

  • Data Engineer

    2 months ago


    Anywhere in India,Multiple Locations SKEP IT SYSTEMS Full time

    Job Description : We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...