Data Engineer(Pyspark, AWS and SQL)

1 month ago


chennai, India Virtusa Full time
Data Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.
Expertise in AWS and python coding.
Flexible to learn and work for any programming language based on need.
Proficient in pipeline for file loading from multiple different sources having different file format using AWS Glue, S3, Lambda and also includes numerous transformations for data sanitization
Strong knowledge of RDBMS and SQL
Good skills in refactoring, writing clean code, and following best coding practices
Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses
Work experience as a Python AWS Developer.
Knowledge of object-relational mapping (ORM)
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Familiar with CI/CD concepts and tools (Jenkins) Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills Python Years of Experience 5 Travel No
  • AWS Data Engineer

    2 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    3 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Data Engineer

    4 weeks ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    4 weeks ago


    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...


  • Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...


  • Hyderabad,Bangalore,Chennai,Vishakhapatnam,Vizag, India Mouri Tech (P) Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, : - Minimum of 6-9 Experience with the core AWS Services and setting...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • Tableau Developer

    3 weeks ago


    Bangalore/Chennai, Tamil Nadu, India Sam manpower services & Career LLP Full time

    Tableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability, considering...

  • Tableau Developer

    1 month ago


    Bangalore,Chennai, India Sam manpower services & Career LLP Full time

    Tableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...

  • Data Engineer

    3 weeks ago


    Chennai,Hyderabad,Bangalore, India HNM Solutions Full time

    Note : Only immediate joiner Role : Pyspark Experience : 8+ years Location : Hyderabad, Chennia Interview mode is Walkin drive Requirements : Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory) 1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive)...

  • Data Engineer

    3 weeks ago


    Chennai/Hyderabad/Bangalore, IN HNM Solutions Full time

    Note : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....


  • chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • Chennai, India SecureKloud Full time

    ResponsibilitiesProven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks


  • chennai, India SecureKloud Full time

    Responsibilities Proven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks

  • Big Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, India Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Big Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, IN Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Data Engineer

    1 month ago


    Chennai, India HNM Solutions Full time

    Role : Data Engineer with PythonLocation : ChennaiExperience : 5+ yearsRequirements :Data Engineer with Python experts :Minimum 5 years in Data engineering role with Python along with relevant experience.1. Strong working experience in Python programming.2. Expertise with one of the Python frameworks - pyspark,3. strong experience with using pandas, numpy,...

  • Senior Data Engineer

    4 weeks ago


    Chennai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • Data Streaming

    4 weeks ago


    Chennai, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...