
Python, Pyspark
6 hours ago
Python, Pyspark
5
Technology Lead (Data Engineer)
BE
- 8+ years of industry experience as Lead Developer
- Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
- Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
- Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
- Advanced Proficiency in Python and SQL.
- Familiarity with Unix.
- Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
- Familiarity in cloud native tools - AWS is preferred
- Familiarity with CI/CD process from developer point of view.
- Familiarity with Change Data Capture systems is nice to have.
- Familiarity with Docker is nice to have
-
Python,pyspark with Aws
1 day ago
Bengaluru, India Natobotics Technologies Private Limited Full time**INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...
-
Pyspark, Python, SQL
3 days ago
Bengaluru, Karnataka, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...
-
SDE-Python/Pyspark
4 weeks ago
Bengaluru, Karnataka, India VidPro Consultancy Services Full timeJob DescriptionExperience: 4 - 7 YearsLocation: Whitefield - BangaloreWork Mode: HybridMandatory Skills: Python, PySpark, AWS, SQL, DSA, Databricks,Hadoop,spark,mapreduce,HBase.Responsibilities: Good development practices- Hands on coder with good experience in programming languages likePython or Pyspark .- Hands-on experience on the Big Data stack like...
-
Pyspark
6 hours ago
Bengaluru, India Riverforest Connections Full timePosition Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...
-
Python pyspark Developer
3 days ago
Bengaluru, Pune, India Infosys Full time US$ 90,000 - US$ 1,20,000 per yearJob descriptionHiring for Python Pyspark developer with experience range 3 to 8 yearsMandatory Skills: Python, Pyspark and sparkEducation: BE/B.Tech/MCA/M.Tech/MSc./MSResponsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project...
-
Python Pyspark Data Engineer
4 days ago
Bengaluru, Karnataka, India DXC Technology Full timePython Pyspark Data Engineer Job Location Hyderabad Bangalore Chennai Kolkata Noida Gurgaon Pune Indore Mumbai Strong Python Skills - Proficient in Python for data manipulation automation and building reusable components Data Pipeline Development - Experience designing and maintaining ETL data pipelines using tools like Airflow or...
-
Pyspark consultant
3 days ago
Bengaluru, Karnataka, India Talan Enterprises Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCompany name- DeloittePySpark Consultantexperience yrsSkills Required- Pyspark,python,Aws3 ,Hadoop,sql,ci/cd
-
Pyspark-gurgaon
7 days ago
Bengaluru, Karnataka, India Cognizant Full time**Skill**: Pyspark **Experience**: 5 to 14 years **Location**: Gurgaon **Drive Date: 1st Feb 25 (In-Person)** - Design, develop, maintain efficient and scalable solutions using PySpark - Ensure data quality and integrity by implementing robust testing, validation and cleansing processes - Integrate data from various sources, including databases, APIs,...
-
Pyspark
1 day ago
Bengaluru, Karnataka, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per yearhighly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...
-
Data engineer_(Pyspark, Python, AWS)
3 days ago
Bengaluru, Karnataka, India Vgmt Global It Services Full time US$ 90,000 - US$ 1,20,000 per yearResponsibilities:* Design, develop & maintain data pipelines using PySpark, Python & AWS* Optimize performance through Spark Streaming on Amazon EMR/EC2* Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Ex Big DataFlexi workingCafeteriaWork from homeFood allowanceHealth insuranceRelocation bonus