Senior Data Engineer

2 weeks ago

Remote, India 3Pillar Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.

As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering

Responsibilities:
  • Lead the design and implementation of scalable ETL/data pipelines using Python for data processing.
  • Ensure efficient data processing for high-volume clickstream, demographics, and business data.
  • Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption.
  • Use Snowflake components/tools - Snowpipe, SnowSQL, SnowPark etc
  • Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization.
  • Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security.
  • Support data storage and retrieval workflows using S3 and SQL-based storage solutions.
  • Provide architectural guidance for cloud-native data solutions and infrastructure design.
  • Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans.
  • Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints.
  • Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy.
  • Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues.
  • Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges.
  • Document workflows, troubleshooting procedures, and code for system transparency and continuity.
  • Provide mentoring and training to team members on best practices and technical skills.
  • Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team.
Qualification
  • Experience: 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects.
  • Cloud Data Warehousing: Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms.
  • Programming & Scripting: Strong programming skills in Python for automation and data workflows.
  • Data Processing & Storage: Expertise in managing SQL databases for data storage and query optimization.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Experience with the AWS Cloud and data engineering services

  • AWS/Snowflake Support Engineer

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Senior Data Engineer

    3 days ago

    Remote, India OUZ Biryani Central Full time

    Senior Data EngineerContractOffshore- REMOTEJob Description:As a Senior Data Analytics Engineer on the Data Analytics Data Platform (DADP) team, you analyze, develop, and deliver business intelligence solutions using data platform related services on AWS.?The Senior Data Analytics Engineer works directly with clients to ensure their expectations and business...

  • sme sql

    1 week ago

    Remote, India Data Engineer Academy LLP Full time

    We're Hiring: SQL Subject Matter Expert (SME) – Mock Interviews & Mentoring (Part-Time)Remote (India) | Work From Home | Flexible Timings | Pay: $600 – $800 / 80 hoursAbout the OpportunityData Engineer Academy is looking for an experienced SQL Subject Matter Expert (SME) to conduct mock interviews and provide mentorship to aspiring data professionals....

  • Subject Matter Expert Specialist

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per year

    We're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...

  • Senior Data Engineer

    1 week ago

    Remote, India Ipeople Infosysteams LLC Full time

    Senior Data EngineerXometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making it easy for buyers at Fortune 1000 companies to tap into...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Milestone Technologies Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Acute Informatics Pvt. Ltd Full time ₹ 5,01,000 - ₹ 18,45,896 per year

    seeking a highly skilled and experienced Senior Data Engineer to join our dynamicteam. The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment,and writing efficient data pipelines. You will be responsible for designing, developing, andmaintaining robust data infrastructure and pipelines that support our data-driven...

  • Senior Data Engineer

    3 days ago

    Remote, India Fusemachines Full time

    About FusemachinesFusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...

  • Senior Data Engineer

    5 days ago

    Remote, India 3Pillar Global Full time

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.As a Senior Data Engineer, you will hold a crucial...

  • Data Engineer Advisor

    1 week ago

    Remote, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Remote, Karntaka (IN-KA), India (IN). The SAP-to-Databricks Migration...