Sr. Data Engineer

2 weeks ago

Noida, Uttar Pradesh, India 3Pillar Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.

As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering

Responsibilities:

  • Lead the design and implementation of scalable ETL/data pipelines using Python and Luigi for data processing.
  • Ensure efficient data processing for high-volume clickstream, demographics, and business data.
  • Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization.
  • Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security.
  • Support data storage and retrieval workflows using S3 and SQL-based storage solutions.
  • Provide architectural guidance for cloud-native data solutions and infrastructure design.
  • Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans.
  • Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption.
  • Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints.
  • Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy.
  • Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues.
  • Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges.
  • Document workflows, troubleshooting procedures, and code for system transparency and continuity.
  • Provide mentoring and training to team members on best practices and technical skills.
  • Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team.

Minimum Qualifications:

  • Experience: 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects.
  • Cloud Data Warehousing: Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms.
  • Programming & Scripting: Strong programming skills in Python for automation and data workflows.
  • Data Processing & Storage: Expertise in managing SQL databases for data storage and query optimization.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Experience with the AWS Cloud and data engineering services

Thank you,

Kiran Dhanak

3Pillar

  • Digital Engineering Sr. Engineer

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are currently seeking a Digital Engineering Sr. Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Preferred Experience"Ideal candidate has been supporting traditional server based relational databases (SQL Server and Postgresql) for over 5+ years out of which last 3+ years in public cloud environments (GCP and Azure) 5+ years of...

  • Digital Engineering Sr. Engineer

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID:334420NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).At NTT DATA, we know that...

  • Sr. System Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India eSec Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We're Hiring | Sr. System Engineer (Application Engineer) eSec Security Consultants Pvt. Ltd. is expanding our team for the Noida International Airport Project (Jewar, Noida).We're looking for an experienced Sr. System Engineer (Application Engineer) to join us on-site. Role: Sr. System Engineer (Application Engineer) Location: Noida – Jewar (On-site,...

  • Industry Consulting Sr. Manager

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 302076NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Industry Consulting Sr Manager to join our team in Noida Uttar Pradesh IN-UP India IN Role Senior Business...

  • CyberArk Technical Solutions Arch. Sr. Analyst

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 317281NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a CyberArk Technical Solutions Arch. Sr. Analyst to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). PAM...

  • Sr. Staff Engineer

    58 minutes ago

    Noida, Uttar Pradesh, India Weekday AI Full time ₹ 45,00,000 - ₹ 90,00,000 per year

    This role is for one of Weekday's clientsSalary range: Rs Rs ie INR 20-45 LPA)Min Experience: 7 yearsLocation: NOIDA, Gurugram, FaridabadJobType: full-timeRequirementsWe are looking for a customer-obsessed, analytical Sr. Staff Engineer to lead the development and growth of our Tax Compliance product suite. In this role, you'll shape innovative digital...

  • Sr. QE

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 337123NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. QE to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Roles & Responsibilities: Maintain an...

  • Sr Data Scientist

    1 week ago

    Noida, Uttar Pradesh, India Birlasoft Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Country/Region: INRequisition ID: 30111Work Model:Position Type:Salary Range:Location: INDIA - NOIDA- BIRLASOFT OFFICETitle: Sr Data ScientistDescription:Area(s) of responsibilityData Scientist experience (8 to 10 years)5 years of relevant work experience as a data scientistExperience designing and building statistical forecasting models.Experience in...

  • Sr. Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India R Systems Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a highly skilledSenior Consultant - Data Engineerwith expertise inAzure Data Factory (ADF), Databricks, and Azure Cloudto design, build, and optimize scalable data solutions. The ideal candidate will have hands-on experience in implementing modern data pipelines, ETL/ELT processes, and data integration strategies to support analytics and...

  • Sr. Mechanical Desing Engineer

    1 week ago

    Noida, Uttar Pradesh, India Aaditya Mechatronics LLP Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionAaditya Mechatronics LLP is a pioneering manufacturer and trader specializing in Assembly Line, Jig Automobile Assembly, PCB Assembly, Testing Machines, and Industrial Conveyors. Our products are used across various industries and are crafted to meet international standards. We pride ourselves on innovation and delivering high-quality...