Amazon - Data Engineer I - PySpark/Python

Job Description :Duties and Responsibilities :- Maintain knowledge of evolving industry trends, practices, techniques, and standards on Big Data with a focus on AWS cloud technologies and Python/Pyspark from an application development perspective.- Be aware of DevOps practices and follow appropriate steps/tools to effect code migration during development...

Exciting Opportunity Alert! We are currently inviting applications for a Managerial Data Engineer position with the following requirements :- Advanced SQL (windows functions & CTE's) .- Python .- Pyspark .- Design and solutioning skills .- Experience in handling teams and stakeholders .- Business acumen .- Strong logical skills .- Good communication...

We are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand data...

Requirements :- Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions.- Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...

Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...

Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

Job Overview:- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.Location: India...

Experience Required :- Minimum 7+ years Experience in Data Engineering.- Must have good knowledge and experience in Python.- Mush have good Knowledge of Pyspark.- Mush have good Knowledge of Databricks.- Must have good experience in AWS (Glue, Athena, Redshift, EMR)- Typically requires relevant analysis work and domain-area work experience.- Expert in the...

Mandatory Skills : - Microsoft Azure, Pyspark, Data Bricks, Hadoop, Spark, Airflow, KafkaRequirments :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using.- SQL, Spark, Python, Airflow, ScalaKafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...

Job Description :- 7 years' experience in developing scalable Big Data applications or solutions on distributed platforms.- Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions.- Strong skills building positive relationships across Product and Engineering.- Able to influence and...

Job Description :- We are seeking a highly skilled Senior Data Engineer with 3-12 years of experience to join our dynamic team.- As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our analytics and business intelligence initiatives.- You will leverage your expertise in data...

Job Description : We are looking for a highly skilled Senior Data Engineer with extensive experience in data integration, processing, and application development for handling large-scale data sets measured in Terabytes from multiple sources.- The ideal candidate will have a strong background in AWS services, particularly Lambda, EMR, and Glue, along with...

Job Description : Title : Data ScientistExperience : 2 to 5 years Location : Bangalore Role And Responsibilities : - Learn and become an expert in Audience Measurement, with a focus on streaming meter technology used for data collection and crediting.- Contribute to analysis plan design, develop underlying data pipelines, execute analyses and summarize...

Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...

Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

What are we looking for!- Proven experience in implementing and delivering data solutions and pipelines on AWS.- Cloud Platform by using services AWS Glue, Lambda, Redshift. - Strong SQL, Python & Pyspark knowledge. - Hands-on experience in AWS, Databricks, Snowflake - Snowflake Integration experience is must. - Familiar with Snowflake architecture warehouse...

What You'll Do :- Solely own your product; Build the product from scratch- Collaborate with the business team to understand business requirements and define tech roadmap- Working on complex architectural problems- Have an understanding of loopholes in current system/architecture which can potentially break in future and push towards solving them with...

Job Description:We are seeking a talented and motivated Data Engineer to join our team. The ideal candidate should have a strong background in SQL, Python, ETL, and data visualization, with experience working closely with stakeholders and providing data support to Data Analysts. As a Data Engineer, you will play a key role in developing data pipelines,...