Senior Data Engineer

5 days ago

Remote, India 3Pillar Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.

As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering

Responsibilities:
  • Lead the design and implementation of scalable ETL/data pipelines using Python for data processing.
  • Ensure efficient data processing for high-volume clickstream, demographics, and business data.
  • Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption.
  • Use Snowflake components/tools - Snowpipe, SnowSQL, SnowPark etc
  • Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization.
  • Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security.
  • Support data storage and retrieval workflows using S3 and SQL-based storage solutions.
  • Provide architectural guidance for cloud-native data solutions and infrastructure design.
  • Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans.
  • Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints.
  • Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy.
  • Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues.
  • Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges.
  • Document workflows, troubleshooting procedures, and code for system transparency and continuity.
  • Provide mentoring and training to team members on best practices and technical skills.
  • Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team.
Qualification
  • Experience: 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects.
  • Cloud Data Warehousing: Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms.
  • Programming & Scripting: Strong programming skills in Python for automation and data workflows.
  • Data Processing & Storage: Expertise in managing SQL databases for data storage and query optimization.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Experience with the AWS Cloud and data engineering services

  • Senior Azure Data Engineer

    7 days ago

    Remote, India Data PlatformExperts Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...

  • AWS/Snowflake Support Engineer

    4 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 10,000 - ₹ 1,50,000 per year

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Senior Data Engineer

    7 days ago

    Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 12,00,000 per year

    Senior Data Engineer – SnowflakeLocation: Remote or Onsite (as per project needs)Contract Duration: 3 Months (Extendable)Working Hours: 9 hours/day (including lunch break)Experience Required: 5+ years in Data EngineeringRole OverviewWe are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Snowflake, DBT, and SQL to join...

  • sme sql

    2 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 76,800 - ₹ 96,000 per year

    We're Hiring: SQL Subject Matter Expert (SME) – Mock Interviews & Mentoring (Part-Time)Remote (India) | Work From Home | Flexible Timings | Pay: $600 – $800 / 80 hoursAbout the OpportunityData Engineer Academy is looking for an experienced SQL Subject Matter Expert (SME) to conduct mock interviews and provide mentorship to aspiring data professionals....

  • Subject Matter Expert Specialist

    5 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per year

    We're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...

  • Senior Data Engineer

    3 days ago

    Remote, India Ipeople Infosysteams LLC Full time ₹ 20,00,000 - ₹ 35,00,000 per year

    Senior Data EngineerXometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making it easy for buyers at Fortune 1000 companies to tap into...

  • Senior Data Engineer

    7 days ago

    Remote, India f5119caa-7b7e-4a49-bc66-a98c0b6f10aa Full time ₹ 15,01,000 - ₹ 28,45,896 per year

    Senior Data Engineer – GCP & DatabricksContract Duration: 1 Year (extendable based on performance)Experience: 6–9 YearsLocation: Remote (India)Key Skills RequiredMust Have:GCP (Google Cloud Platform) – Level 3 proficiencyDatabricks – Level 3 proficiencyPython, PySparkOracle SQLGood to Have:BigQuery, Cloud ComposerDocker, Kubernetes, CI/CD...

  • Senior Data Engineer

    5 days ago

    Remote, India Milestone Technologies Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    1 week ago

    Remote, India Khoj Information Technology, Inc. Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Data Factory, Databricks, and Microsoft Fabric are requiredWe are seeking a Senior Data Engineer (Azure) who can seamlessly blend hands-on data engineering expertise with a solution design and architectural mindset. This role will be responsible for building scalable, high-performance data solutions on Azure — leveraging Data Factory, Databricks, and...

  • Senior Data Engineer

    7 days ago

    Remote, India Acute Informatics Pvt. Ltd Full time ₹ 5,01,000 - ₹ 18,45,896 per year

    seeking a highly skilled and experienced Senior Data Engineer to join our dynamicteam. The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment,and writing efficient data pipelines. You will be responsible for designing, developing, andmaintaining robust data infrastructure and pipelines that support our data-driven...