Data Engineer(Pyspark, AWS and SQL)
1 month ago
Expertise in AWS and python coding.
Flexible to learn and work for any programming language based on need.
Proficient in pipeline for file loading from multiple different sources having different file format using AWS Glue, S3, Lambda and also includes numerous transformations for data sanitization
Strong knowledge of RDBMS and SQL
Good skills in refactoring, writing clean code, and following best coding practices
Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses
Work experience as a Python AWS Developer.
Knowledge of object-relational mapping (ORM)
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Familiar with CI/CD concepts and tools (Jenkins) Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills Python Years of Experience 5 Travel No
-
AWS Data Engineer
2 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
AWS Data Engineer
3 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Data Engineer
4 weeks ago
Chennai, India Randstad Full timeRole : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...
-
Data Engineer
4 weeks ago
Chennai, India Randstad Full timeRole : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Randstad Full timeRole : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...
-
Wavicle Data Solutions
2 weeks ago
Chennai/Coimbatore, India Wavicle data solutions Full timeJob Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...
-
Senior Cloud Data Engineer
1 month ago
Hyderabad,Bangalore,Chennai,Vishakhapatnam,Vizag, India Mouri Tech (P) Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, : - Minimum of 6-9 Experience with the core AWS Services and setting...
-
Senior Cloud Data Engineer
3 weeks ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...
-
Tableau Developer
3 weeks ago
Bangalore/Chennai, Tamil Nadu, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability, considering...
-
Tableau Developer
1 month ago
Bangalore,Chennai, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...
-
Data Engineer
3 weeks ago
Chennai,Hyderabad,Bangalore, India HNM Solutions Full timeNote : Only immediate joiner Role : Pyspark Experience : 8+ years Location : Hyderabad, Chennia Interview mode is Walkin drive Requirements : Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory) 1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive)...
-
Data Engineer
3 weeks ago
Chennai/Hyderabad/Bangalore, IN HNM Solutions Full timeNote : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....
-
Data Engg Python Pyspark
1 week ago
chennai, India Virtusa Full timeData Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...
-
Chennai, India SecureKloud Full timeResponsibilitiesProven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks
-
chennai, India SecureKloud Full timeResponsibilities Proven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks
-
Big Data Engineer
2 weeks ago
Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, India Tata Elxsi Full timeJob Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...
-
Big Data Engineer
2 weeks ago
Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, IN Tata Elxsi Full timeJob Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...
-
Data Engineer
1 month ago
Chennai, India HNM Solutions Full timeRole : Data Engineer with PythonLocation : ChennaiExperience : 5+ yearsRequirements :Data Engineer with Python experts :Minimum 5 years in Data engineering role with Python along with relevant experience.1. Strong working experience in Python programming.2. Expertise with one of the Python frameworks - pyspark,3. strong experience with using pandas, numpy,...
-
Senior Data Engineer
4 weeks ago
Chennai, India Cyber Sphere LLC Full timeSenior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...
-
Data Streaming
4 weeks ago
Chennai, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...