AWS Glue Databricks Python

Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...

Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...

Shift: UK Shift (if applicable)Job SummaryWe are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best...

Location: Chennai Hybrid (3 Days a Week in Office)Employment Type: ContractShift: UK Shift (if applicable) Job SummaryWe are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based...

• Data Pipeline Development:Design, implement, and manage scalable ETL/ELT pipelines using AWS services and Databricks.• Data Integration:Ingest and process structured, semi-structured, and unstructured data from multiple sources into AWS Data Lake or Databricks.• Data Transformation:Develop advanced data processing workflows using PySpark, Databricks...

AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and various AWS...

Job Description:Cloud platform: AWS, SnowflakeAWS: Athena, AWS Glue, Glue workflow, Lambda, S3, EC2, EBS, CloudWatch, VPC, DynamoDB, API Gateway, IAM, CloudFormation, Kinesis, SQS, SNS, Step Functions, QuickSight, Redshift.Programming languages: Python, PySpark, SQL, JavaScheduler tool: Talend, AirflowInfrastructure as a code tool: TerraformTicketing Tools:...

Role: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 5+Required Technical Skill:Strong Knowledge ofAws Glue/AWS REDSHIFT/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL,DWH, Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...

Job Title : Java AWS Developer with PythonLocation : ChennaiJob ResponsibilitiesDesign, develop, and maintain scalable enterprise applications using Java, Spring Boot, and Python.Build and manage data pipelines and work on Databricks for analytics and transformation tasks.Develop, optimize, and maintain solutions using Oracle databases with strong SQL and...

About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...