Spark + Python

Job Title : Python Developer with Spark and ScalaLocation : Bangalore & ChennaiClient : Socit GnraleShift : UK ShiftJob Description :We are looking for a highly skilled Python Developer with expertise in Spark and Scala to join our team for the Socit Gnrale project. The ideal candidate will also possess secondary skills in Data Lake (LUCID), Azure, and...

Strong expertise in Big Data ecosystem like Spark, Hive, Sqoop, HDFS, Map Reduce, Kafka, Oozie, Yarn, Hbase, Nifi. In depth Knowledge on Architecture of Distributed Systems and Parallel Computing. Experience implementing end to end data pipelines for serving reporting and data science capabilities. Strong experience working with various configurations of...

Job Description :What you'll do :- Design, implementation, and improvement of processes & automation of Data infrastructure- Tuning of Data pipelines for reliability & performance- Building tools and scripts to develop, monitor, troubleshoot ETL's- Perform scalability, latency, and availability tests on a regular basis.- Perform code reviews and QA...

Mandatory Skills : AWS, Python, SQL, spark, Airflow, SnowflakeResponsibilities :- Create and manage cloud resources in AWS- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and...

Hiring For Apache Spark with Pyspark Apache Spark with PysparkDesired ProfileSkills : Pyspark, Big Data, Apache Spark and Python programming, Cloud technology architecture like AWSExperience: 4-6 years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data...

Role : Data Modeling - MandatoryTools : Magic Draw, Erwin or ER Studio (any one)DB : Python, SQL, Oracle, Postgres, Teradata, Mongo DB (any one)Responsibilities :- Hands-on relational, dimensional, and/or analytic experience (using RDBMS, dimensional, and ETL and data ingestion protocols)- Experience with data warehouse, data lake, and enterprise big data...

Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...

Must have skills: Strong C/C++, Python programming language expertise Production ready and open source ready S/W development Ability to create pipelines that include multiple programming languages ( C++ and Python) Experience with a version control system ( github) Ability to work on Linux based operating system. Good to have expertise: Deep Learning...

Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

Job Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

Spark Scala Data Engineer - Bangalore/ Chennaiat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32 cities across...

Job Description :The role will be responsible for building quantitative software libraries to estimate Greenhouse Gas Emissions resulting from the bank's financing activities.Responsibilities : Designing and Developing mathematical software packages using Python Frontend workflow development to allow endusers to run the calculators Writing efficient software...

Spark Scala Data Engineer - Bangalore/ Chennai at Capco India Job Title: Data Engineer with Spark and Scala About Us "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies for Women in India by . With our presence...

Job Description :Must Have Skill :- 6+ years of experience in information technology, with 4+ years spent in Informatica Platform Engineering/Administration- Informatica installation, configuration, and administration (upgrade, optimization, Performance management).- Scripting languages (e. , Python, Shell) for automation, Hadoop, and Spark.- In-depth...

Job Description :The role will be responsible for building quantitative software libraries to estimate Greenhouse Gas Emissions resulting from the bank's financing activities.Responsibilities :- Designing and Developing mathematical software packages using Python- Front-end workflow development to allow end-users to run the calculators- Writing efficient...

Job Description :- A minimum of 10+ years of experience in data architecture and analytics. - Databricks : Proficiency in Databricks for data processing, machine learning, and analytics. - Cloud Platforms : Strong experience with any one or more cloud platforms such as AWS, Azure, GCP, and the ability to integrate Databricks with them. - Data Engineering :...

SummaryAnalytics -Python developer role inherit qualities with developing a unified, modular, and generalized data platform that integrates with different data sources and source systems, ensures data quality, models, and then exposes the data for consumption by other teams and platforms. Executing tests on software usability. Analysing results on database...

SummaryAnalytics - Python developer role inherit qualities with developing a unified, modular, and generalized data platform that integrates with different data sources and source systems, ensures data quality, models, and then exposes the data for consumption by other teams and platforms. Executing tests on software usability. Analysing results on database...

Data Engineer - ETL with Python, Spark & Hadoop Women's Drive - 2nd March -Chennai - Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions Craft and implement data pipelines utilizing Spark and Python Define and deliver reusable components for ETL/ELT...