Sr. Data Engineer
2 days ago
Position Summary:
We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.
Responsibilities:
- Design, develop, and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
- Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into Azure Synapse Analytics.
- Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
- Collaborate with data analysts to understand data requirements and ensure data quality.
- Hands-on experience in designing and developing Datalakes and Warehouses
- Implement data governance practices to ensure data security and compliance.
- Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
- Develop and maintain unit tests for data pipeline code.
- Work collaboratively with other engineers and data professionals in an Agile development environment.
Preferred Skills & Experience:
- Good knowledge of PySpark & working knowledge of Python
- Full stack Azure Data Engineering skills (Azure Data Factory, DataBricks and Synapse Analytics)
- Experience with large dataset handling
- Hands-on experience in designing and developing Datalakes and Warehouses
New Vision is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees
-
Lead Data Engineer
2 days ago
APAC, Maharashtra, India, Pune office Standard, Pune, Hybrid NewVision Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAs an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the organization.Key Responsibilities:Technical...
-
Sr Data Engineer
4 weeks ago
Pune, Maharashtra, India, Maharashtra Populace World Solutions Full timeJob Title: Sr. Data EngineerExperience: 8+ YearsLocation: Pune (Kharadi)Job Description8+ years of experience as a big data engineer.Must be proficient with Python & PySparkIn-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file formatGood to haves...
-
Sr Data Engineer
4 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description - 8+ years of experience as a big data engineer. - Must be proficient with Python & PySpark - In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services - Must have extensive experience with Delta Tables, JSON, Parquet file format...
-
Sr Data Engineer
4 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...
-
Sr Data Engineer
4 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...
-
Sr Data Engineer
3 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data Engineer Experience: 8+ Years Location: Pune (Kharadi) Job Description 8+ years of experience as a big data engineer. Must be proficient with Python & PySpark In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services Must have extensive experience with Delta Tables, JSON, Parquet file format Good to...
-
Sr. Data Engineer
10 hours ago
Pune, Maharashtra, India ImmersiveData Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Description: Sr. Data EngineerLocation: Unit No.506, 5th Floor Solitaire Business Hub, Survey Number: 27/1, Balewadi high Street, Baner,Pune-411045Experience: 4+ yearsPosition:Sr. Data EngineerAbout Immersive At Immersive , we are building next-generation AI and data-driven platforms that help enterprises unlock the true power of their data. We...
-
Sr Data Engineer
2 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data Engineer Experience: 8+ YearsLocation: Pune (Kharadi)Job Description8+ years of experience as a big data engineer.Must be proficient with Python & PySparkIn-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics servicesMust have extensive experience with Delta Tables, JSON, Parquet file...
-
Sr Data Engineer
3 weeks ago
Pune, India Populace World Solutions Full timeJob Title: Sr. Data EngineerExperience: 8+ YearsLocation: Pune (Kharadi)Job Description- 8+ years of experience as a big data engineer.- Must be proficient with Python & PySpark- In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services- Must have extensive experience with Delta Tables, JSON, Parquet file format- Good...
-
Sr. Business Analyst
2 days ago
India, Hybrid, Hyderabad, APAC, Hyderabad office standard, Telangana NewVision Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSr. Business Analyst - Product ConfigurationNew Vision has created a culture of Thinking Minds, which fosters creative thinking and problem solving for our customers. We expertise in building Custom IT solutions. Our endeavor is to create a positive impact on the bottom-line of the clients and helping them increase their profitability, thereby building a...