Senior Data Engineer
7 days ago
Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.
As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering
Responsibilities :
- Lead the design and implementation of scalable ETL/data pipelines using Python and Luigi for data processing.
- Ensure efficient data processing for high-volume clickstream, demographics, and business data.
- Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization.
- Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security.
- Support data storage and retrieval workflows using S3 and SQL-based storage solutions.
- Provide architectural guidance for cloud-native data solutions and infrastructure design.
- Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans.
- Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption.
- Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints.
- Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy.
- Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues.
- Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges.
- Document workflows, troubleshooting procedures, and code for system transparency and continuity.
- Provide mentoring and training to team members on best practices and technical skills.
- Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team.
Minimum Qualifications :
- Experience : 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects.
- Cloud Data Warehousing : Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms.
- Programming & Scripting : Strong programming skills in Python for automation and data workflows.
- Data Processing & Storage : Expertise in managing SQL databases for data storage and query optimization.
- Monitoring & Alerting Tools : Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
- Experience with the AWS Cloud and data engineering services
-
Senior Data Engineer
1 week ago
Noida, Uttar Pradesh, India Dhurin Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole : Senior Data EngineerAbout The CompanyDhurin is a fast-growing data science consulting firm focused on the BFSI sector. We partner with banks, fintech and financial institutions mainly in Indian market to solve complex challenges in risk, fraud, collections, marketing, sales, and operations.Were a niche, analytics-driven team where your work directly...
-
Senior Data Engineer
7 days ago
Noida, Uttar Pradesh, India QUARKS TECHNOSOFT PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description : We are looking for a Senior Data Engineer with 6 years of hands-on experience in designing and building scalable, cloud-native data solutions. This role is ideal for someone who is passionate about data architecture, enjoys solving complex data problems, and thrives in fast-paced, collaborative environments. The ideal candidate should...
-
Senior Data Engineer
6 days ago
Noida, Uttar Pradesh, India TechnePlus Full time ₹ 15,00,000 - ₹ 28,00,000 per yearCompany DescriptionAt TechnePlus, we believe technology is most powerful when it brings people together and solves real-world challenges. Our diverse and passionate team partners with clients to create digital solutions that drive growth, efficiency, and meaningful change. We specialize in a full spectrum of consulting and IT services, including Digital...
-
Senior Data Engineer
1 day ago
Noida, Uttar Pradesh, India Eice Technology Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob Title: Senior Data Engineer, Microsoft Fabric + SSIS SpecialistLocation: Noida, Sector 62 (Onsite, Full-Time, Long-Term Project)Experience Required: 7 + YearsAvailability: Immediate Joiners OnlyRole Overview:We are looking for a highly skilled Senior Data Engineer 7+ years of experience as a Microsoft Fabric Specialist to lead the design, development,...
-
Senior Data Engineer
1 week ago
Noida, Uttar Pradesh, India Delhivery Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Delhivery:Delhivery is India's leading fulfillment platform for digital commerce. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge...
-
Senior Data Engineer
2 weeks ago
Noida, Uttar Pradesh, India Edge Corporation Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title : Senior Data EngineerJob SummaryA Sr Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data collection, transformation, and analysis. They work closely with data scientists, analysts, and business stakeholders to ensure data is accessible, reliable, and optimized for...
-
Senior Data Engineer
6 days ago
Noida, Uttar Pradesh, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data Engineer – Azure & DatabricksLocation:Noida (WFO)Skills Required: Digital : Microsoft AzureExperience Range Required: 8 to 10 Years(Rel 7+ yrs)Job Description:Must-HaveLead Back-end development maintenance of Data Quality ProductDesign and develop Data Pipeline using ADF, Databricks and integrate with other Azure ServicesExperience...
-
Senior Data Engineer
2 weeks ago
Noida, Uttar Pradesh, India Amicon Hub Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Data EngineerExperience: 5 – 8 YearsEmployment Type: Contract to Hire (C2H)Location: Noida / IndoreAbout the Role:We are seeking a highly skilled and detail-oriented Senior Data Engineer to join our dynamic team. The ideal candidate will have strong expertise in SQL, SSAS, OLAP, and BI tools, along with the ability to design and implement...
-
Senior Data Engineer
1 day ago
Noida, Uttar Pradesh, India 3Pillar Full time ₹ 8,00,000 - ₹ 24,00,000 per yearEmbark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.As a Senior Data Engineer, you will hold a crucial...
-
Senior Data Engineer
1 week ago
Noida, Uttar Pradesh, India Iris Software Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and develop robust data pipelines and ETL processesSupport data migration from traditional systems (Oracle, Vertica) to modern cloud platforms (Snowflake, AWS)Build and maintain scalable data ingestion and transformation frameworksOptimize and tune data queries for performance and efficiencyImplement and manage cloud-based data solutions (Snowflake,...