Senior Data Engineer

5 days ago

Remote, India 3Pillar Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making.

As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering

Responsibilities:
  • Lead the design and implementation of scalable ETL/data pipelines using Python for data processing.
  • Ensure efficient data processing for high-volume clickstream, demographics, and business data.
  • Lead the strategic planning, execution, and optimization of large-scale data migration initiatives to Snowflake, ensuring data integrity, security, and minimal business disruption.
  • Use Snowflake components/tools - Snowpipe, SnowSQL, SnowPark etc
  • Guide the team in adopting best practices for data pipeline development, code quality, and performance optimization.
  • Configure, deploy, and maintain AWS infrastructure, primarily AWS EC2, S3, RDS, and EMR, to ensure scalability, availability, and security.
  • Support data storage and retrieval workflows using S3 and SQL-based storage solutions.
  • Provide architectural guidance for cloud-native data solutions and infrastructure design.
  • Oversee legacy framework maintenance, identify improvement areas, and propose comprehensive cloud migration or modernization plans.
  • Coordinate infrastructure changes with stakeholders to align with business needs and budget constraints.
  • Develop and implement robust monitoring solutions to track system health, performance, and data pipeline accuracy.
  • Set up alerts and dashboards for proactive issue detection and collaborate with cross-functional teams to resolve critical issues.
  • Lead efforts in incident response, root cause analysis, and post-mortem processes for complex data engineering challenges.
  • Document workflows, troubleshooting procedures, and code for system transparency and continuity.
  • Provide mentoring and training to team members on best practices and technical skills.
  • Foster a culture of continuous learning, knowledge sharing, and technical excellence within the data engineering team.
Qualification
  • Experience: 6 years of experience in data engineering or a related technical field, with at least 4 years in a Snowflake projects.
  • Cloud Data Warehousing: Proven expertise with Snowflake data warehousing, including schema design, efficient data loading (e.g., Snowpipe, COPY into), performance tuning, and robust access control mechanisms.
  • Programming & Scripting: Strong programming skills in Python for automation and data workflows.
  • Data Processing & Storage: Expertise in managing SQL databases for data storage and query optimization.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Experience with the AWS Cloud and data engineering services

  • Senior Data Engineer

    1 week ago

    Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 12,00,000 per year

    Senior Data Engineer – SnowflakeLocation: Remote or Onsite (as per project needs)Contract Duration: 3 Months (Extendable)Working Hours: 9 hours/day (including lunch break)Experience Required: 5+ years in Data EngineeringRole OverviewWe are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Snowflake, DBT, and SQL to join...

  • Azure AI Data Engineer

    1 week ago

    Remote, India Data PlatformExperts Full time ₹ 70,000 - ₹ 15,00,000 per year

    Job Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...

  • sme sql

    3 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 76,800 - ₹ 96,000 per year

    We're Hiring: SQL Subject Matter Expert (SME) – Mock Interviews & Mentoring (Part-Time)Remote (India) | Work From Home | Flexible Timings | Pay: $600 – $800 / 80 hoursAbout the OpportunityData Engineer Academy is looking for an experienced SQL Subject Matter Expert (SME) to conduct mock interviews and provide mentorship to aspiring data professionals....

  • Subject Matter Expert Specialist

    5 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 7,20,000 - ₹ 12,00,000 per year

    We're Hiring: Subject Matter Expert (SME) – Snowflake & Databricks on AWS CloudRemote | Part Time | Flexible Timings | Pay: ₹600 – ₹1000/HourAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 10 years of experience in cloud data...

  • Senior Data Engineer

    5 days ago

    Remote, India Milestone Technologies Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    2 weeks ago

    Remote, India TriDevSofts Full time ₹ 7,00,000 - ₹ 8,00,000 per year

    Job Title: Senior Data Engineer – Databricks (Azure)Location: RemoteEmployment Type: ContractBudget : 70k -80k Per monthAbout the RoleWe are seeking a highly skilled Databricks Engineer with strong expertise in Azure Cloud to design, build, and optimize large-scale data solutions. The ideal candidate will have a solid background in PySpark, SQL/PLSQL, and...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Unify CX Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Required Experience: 8+ Years for Senior Data EngineerPreferred Skillsets: Very Strong Python skills.Very efficient in SQL/Stored procedures.At least 8 years of Hands on Experience in AWS Step function, AWS Lambda, AWS S3, AWS ECS, AWS Cloud Watch, AWS Event Bridge, AWS Athena, AWS Glue.At least 8 years of Experience in TerraformAt least 8 years of...

  • Senior Data Engineer

    3 days ago

    Remote, India Rojgar group Full time ₹ 15,00,000 - ₹ 21,00,000 per year

    Senior Data EngineerAbout the RoleWe are seeking an experienced **Senior Data Engineer** with expertise in cloud data engineering to join our team. This is an exceptional opportunity for a seasoned professional to work on complex data solutions, leveraging Azure cloud services and Snowflake data platform in a fully remote environment.Position...

  • Senior Data Integration Engineer

    2 weeks ago

    Remote, India AK Infolution Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About the Role:We are seeking a Senior Data Integration Engineer with 7–10 years of experience in building and managing enterprise-grade data solutions. The ideal candidate will have strong expertise in SnapLogic, Snowflake, and MDX, and will drive the design and optimization of scalable data pipelines to support analytics and business decision-making.Key...

  • Senior Data Engineer

    1 week ago

    Remote, India Ebizon Full time

    We are looking for Data Architect/ Senior Data Engineer to join our team. Responsibilities: Design and drive end to end data and analytics solution architecture from concepttodelivery Design, develop, and support conceptual/logical/physical data models for analyticssolutions. Ensures that industry-accepted data architecture principles,standards,...