Senior Data Engineer

2 days ago

India 3Pillar Full time US$ 90,000 - US$ 1,20,000 per year
Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making
As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering
Responsibilities: Lead the design and implementation of scalable ETL/data pipelines using Python and Luigi for data processing. Ensure efficient data processing for high-volume clickstream, demographics, and business data. Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization. Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security. Support data storage and retrieval workflows using S3 and SQL-based storage solutions. Provide architectural guidance for cloud-native data solutions and infrastructure design. Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans. Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption. Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints. Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy. Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues. Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges. Document workflows, troubleshooting procedures, and code for system transparency and continuity. Provide mentoring and training to team members on best practices and technical skills. Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team. Qualification Experience: 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects. Cloud Data Warehousing: Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms. Programming & Scripting: Strong programming skills in Python for automation and data workflows. Data Processing & Storage: Expertise in managing SQL databases for data storage and query optimization. Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines. Experience with the AWS Cloud and data engineering services

  • Senior Data Engineer

    4 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Senior Azure Stack Engineer

    3 days ago

    Remote, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN).Job Title: Senior Azure Stack...

  • Senior Data Engineer

    2 days ago

    India ADP Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior Data Engineer with MLAbout the RoleWe are seeking an experienced Senior Data Engineer with 5-10 years of experience to join our data team. In this role, you will design, build, and maintain robust data pipelines that support both training and inference for our machine learning systems. You will work closely with data scientists to ensure seamless...

  • Senior Data Engineer

    2 days ago

    India Kinara Capital Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    1 About Company Kinara Capital is a FinTech NBFC dedicated to driving Financial Inclusion in the MSME sector. Our mission is to transform lives, livelihoods, and local economies by providing fast and flexible loans without property collateral to small business entrepreneurs. Led by a women-majority management team, Kinara Capital values diversity and...

  • Senior Data Engineer

    2 days ago

    India Recruber Full time US$ 1,04,000 - US$ 1,30,878 per year

    Position: Senior Data Engineer / Data EngineerDesired Experience: 5-8 yearsLocation - RemoteSalary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for...

  • Senior Data Engineer

    4 days ago

    India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a vital role in designing, building, and maintaining large-scale data systems.About the Role:The ideal candidate will have a strong background in software engineering, with experience in building...

  • Senior Engineer, Data Engineering

    5 days ago

    India Collabera Full time

    Senior Data Engineer Fully Remote Shift: US Time Zone (Night Shift)Financial Institution (FI) - Credit Union Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for someone with deep expertise in ETL...

  • Data Engineering Leader

    2 days ago

    India beBeeAzure Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Azure Data EngineerWe are currently seeking a seasoned Senior Azure Data Engineer to spearhead our data infrastructure initiatives.

  • Senior Data Engineer

    3 weeks ago

    India 3Pillar Global Full time

    Job DescriptionEmbark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.As a Senior Data Engineer, you will hold...

  • Senior Data Engineer

    2 days ago

    India Welocalize Full time

    Welocalize is seeking a Senior Data Engineer with world-class Python expertise and a sharp eye for data quality engineering rigor and visualization fidelity In this role you will create realistic datasets write intuitive prompts and develop high-quality golden plots to power insightful data tasks You ll bridge technical precision with real-world...