Oracle + PySpark Data Engineer
1 hour ago
Job Description:
Experiance:5 to 7 Years
We are seeking a highly skilled and motivated Oracle + PySpark Data Engineer/Analyst to join our team. The ideal candidate will be responsible for leveraging the Oracle database and PySpark to manage, transform, and analyze data to support our business's decision-making processes. This role will play a crucial part in maintaining data integrity, optimizing data processes, and enabling data-driven insights.
Key Responsibilities:
1. Data Integration: Integrate data from various sources into Oracle databases and design PySpark data pipelines to enable data transformation and analytics.
2. Data Transformation: Develop and maintain data transformation workflows
using PySpark to clean, enrich, and structure data for analytical purposes.
3. Data Modeling: Create and maintain data models within Oracle databases,
ensuring data is structured and indexed for optimal query performance.
4. Query Optimization: Write complex SQL queries and PySpark transformations for efficient data retrieval and processing.
5. Data Analysis: Collaborate with data analysts and business teams to provide insights through data analysis and reporting.
6. Data Quality: Implement data quality checks, error handling, and validation
processes to ensure data accuracy and reliability.
7. Performance Tuning: Optimize Oracle database and PySpark jobs to improve
Known Tools
- Proven experience in working with Oracle databases and PySpark.
Strong proficiency in SQL, PL/SQL, Python, and PySpark. - Familiarity with Oracle database administration, data warehousing, and ETL concepts.
- Understanding of big data technologies and distributed computing principles.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Knowledge of data security and compliance standardsand overall data processing and analysis performance.
- Documentation: Create and maintain comprehensive documentation for data
models, ETL processes, and codebase
-
Data Engineer, Pyspark
1 week ago
Bengaluru, Karnataka, India NatWest Group Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per yearJoin us as a Data EngineerWe're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secureDay-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insightsIf you're...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearMigrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....
-
Senior Data Engineer
6 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per yearBuild scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...
-
Sr. Snowflake Data Engineer Pyspark
1 week ago
Bengaluru, Karnataka, India EduRun Group Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Data Engineer | 10-12 Years Experience | Must Have: Proven expertise in building scalable batch and streaming data pipelines using Databricks (PySpark) and Snowflake.Lead the design, implementation, and optimization of application data stores using PostgreSQL, DynamoDB, and advanced SQL.Strong programming skills in SQL, Python, and PySpark for...
-
Python Developer with AWS
9 minutes ago
Bengaluru, Karnataka, India Oracle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Oracle FSGIU - Finergy:Finergy division within Oracle FSGIU exclusively focuses on the Banking, Financial Services, and Insurance (BFSI) sector, offering deep domain knowledge to address complex financial needs. Finergy has Industry expertise in BFSI. (On Accelerated Implementation) Finergy has Proven methodologies that fast-track the deployment of...
-
Fabric Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Quest Global Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Requirements At Quest Global, it's not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that...
-
Data Engineer
3 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 345819NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role:...
-
Data Engineer
5 days ago
Bengaluru, Karnataka, India Weekday AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearThis role is for one of the Weekday's clientsMin Experience: 4 yearsLocation: Pune, BangaloreJobType: full-timeWe are looking for an experienced Data Engineer with strong capabilities across SQL, ETL, Data Warehousing, BI, DevOps, and CI/CD—combined with hands-on experience in core banking systems and regulatory reporting pipelines. The ideal candidate...
-
Data Engineer
5 days ago
Bengaluru, Karnataka, India Weekday AI Full time ₹ 8,00,000 - ₹ 12,00,000 per yearThis role is for one of the Weekday's clientsMin Experience: 4 yearsLocation: Pune, BangaloreJobType: full-timeWe are looking for an experienced Data Engineer with strong capabilities across SQL, ETL, Data Warehousing, BI, DevOps, and CI/CD—combined with hands-on experience in core banking systems and regulatory reporting pipelines. The ideal candidate...
-
Data Engineer with SQL/ETL/Pyspark
5 days ago
Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...