AWS Data Engineer with PySpark

AWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...

Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data BricksExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark...

We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...

AWS Data EngineerExperience: 5-8 YearsLocation: Bangalore, PuneNotice Period : Immediate Joiner - 30 daysExp - 4+ Yrs in Data Engineering4+ Yrs in AWS ServicesSkills - Hands on exp in Glue is mandatory.Exposure to Lambda,Redshift,RDS,S3+ Python/Scala/Pyspark + SQL. Experience in solution designing.Job Description : Strong AWS development experience for data...

Job Description : AWS Glue + Python PysparkJob Overview : Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...

Candidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...

ob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...

Job Description :AWS Data Engineer with min of 5 to 7 years of experience. Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. Connect with stakeholders daily to discuss project progress and updates. Work within an Agile process to deliver projects in a timely and efficient manner. Design and develop...

ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

SkillsInformatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP +LakeFormation, AWS Native services – AWSCloudWatch and ApacheAirflow, AWS Eventbridge

Job DescriptionMandatory RequirementOverall 8+ years of experience in IT3+ year experience working on Data Engineering using Databricks, Redshift, Glue, EMR.Atleast 4 Project experience in Building and maintaining ETL / ELT pipelines for large data sets , complex data and feature engineering processesMust Have skills : AWS Glue, Databricks (DB), AWS...

Key ResponsibilitiesThis is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform.Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of existing/ new SLF investment product architecture and implement new features in the...

Job Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...

REQ. - REFNAWS Data Engg SpecialistNo Industrial Layout Hosur Road Koramangala, Bengaluru, inFull-timeLegal Entity: Bosch Global Software Technologies Private LimitedCompany DescriptionBosch Global Software Technologies Private Limitedis a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering...

Job Description:Experience: 4 Years 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a strong...

Key ResponsibilitiesThis is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of existing/ new SLF investment product architecture and implement new features in the...

Job Description:Experience:4 Years - 8 YearsJob Location:PAN IndiaNotice Period:Immediate/ 15 DaysShift Timings:03:00 PM to 12:00 AM (IST)Skills:Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a strong...

Job Description:Experience: 4 - 8 YearsLocation: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; Data Pipeline; ETL; AWS (and frameworks); PySpark/Scala; SQL & PythonWe are looking for a skilled Data Engineer to join our team. The perfect candidate must have a solid experience in data...

Big Data Engineer - CREQ190570 DescriptionQualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)...

Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...