Data Engineer(Pyspark, AWS and SQL)

1 week ago


Chennai, Tamil Nadu, India Virtusa Full time

Data Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.

Expertise in AWS and python coding.
Flexible to learn and work for any programming language based on need.
Proficient in pipeline for file loading from multiple different sources having different file format using AWS Glue, S3, Lambda and also includes numerous transformations for data sanitization
Strong knowledge of RDBMS and SQL
Good skills in refactoring, writing clean code, and following best coding practices
Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses
Work experience as a Python AWS Developer.
Knowledge of object-relational mapping (ORM)
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Familiar with CI/CD concepts and tools (Jenkins) Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills Python Years of Experience 5 Travel No
  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India SGS Technical Services Pvt. Ltd Full time

    Job Title : Data : Chennai, IndiaImmediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL controlJob Description :We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL,...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India SGS Technical Services Pvt. Ltd Full time

    Job Title : Data : Chennai, IndiaImmediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL controlJob Description :We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL,...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/639)Job Id: REQ/0639Location: ChennaiExperience: 4 to 8 YearsCTC:8L to 15LDate Posted: 16-May-2024Employment Type: PermanentNoof Openings:5We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/639)Job Id: REQ/0639Location: ChennaiExperience: 4 to 8 YearsCTC:8L to 15LDate Posted: 16-May-2024Employment Type: PermanentNoof Openings:5We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/639)Job Id: REQ/0639Location: ChennaiExperience: 4 to 8 YearsCTC:8L to 15LDate Posted: 16-May-2024Employment Type: PermanentNoof Openings:5We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • Chennai, Tamil Nadu, India SecureKloud Full time

    Responsibilities Proven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks

  • AWS Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India RELX Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- 5 years of experience as a Data Engineer, with a strong proficiency in PySpark, Python, SQL, Databricks, and AWS.- Hands-on experience designing and implementing data pipelines for large-scale data processing and analytics.- Strong understanding of data modeling, data warehousing concepts, and database technologies.- Proficiency in working...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- 5 years of experience as a Data Engineer, with a strong proficiency in PySpark, Python, SQL, Databricks, and AWS.- Hands-on experience designing and implementing data pipelines for large-scale data processing and analytics.- Strong understanding of data modeling, data warehousing concepts, and database technologies.- Proficiency in working...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/0639)Job Id: REQ/0639Location: ChennaiExperience: 5 to 8 YearsCTC:10L to 18LDate Posted: 22-May-2024Employment Type: PermanentNo of Openings:5:We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/0639)Job Id: REQ/0639Location: ChennaiExperience: 5 to 8 YearsCTC:10L to 18LDate Posted: 22-May-2024Employment Type: PermanentNo of Openings:5:We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...


  • Chennai, Tamil Nadu, India timesjobs Full time

    Big Data Engineer Python, Pyspark and SQL (REQ/0639)Job Id: REQ/0639Location: ChennaiExperience: 5 to 8 YearsCTC:10L to 18LDate Posted: 22-May-2024Employment Type: PermanentNo of Openings:5:We are looking for an experienced Python with Pyspark Developer to join our fast-growing technology Team. The ideal candidate will have a strong background with Pyspark,...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...

  • AWS Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Manvision Technologies Full time

    Role Summary: Senior Data EngineerPune/Bangalore/ChennaiAbout the RoleAs a Senior Data Engineer, we are looking for someone passionate about working as part of a team to deliver high-quality, professional dashboards that have a business impact.Experience in years:At least 5 years of hands-on experience using AWS to deliver complex data pipelines for large or...