Senior Data Engineer

3 hours ago

Thiruvananthapuram, Kerala, India Us Technology International Private Limited Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Senior Data Engineers

Experience - 6 +Yrs (5-7 relevant years)

Location: Trivandrum

Mandatory Skill - Pyspark, SQL, Azure Databricks

UK Shift Timing

Job Description

Key Accountabilities / Responsibilities:

  • Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality.
  • Review and optimize
    PySpark
    ,
    SQL
    , and
    Databricks
    code for performance, scalability, and maintainability.
  • Offer engineering support and mentorship to data engineering teams within delivery squads, guiding them in building robust, reusable, and secure data solutions.
  • Collaborate with architects to define data ingestion, transformation, and storage strategies leveraging Azure services such as
    Azure Data Factory
    , Azure Databricks, Azure Data Lakes
  • Drive automation and
    CI/CD
    practices in data pipelines using tools such as
    Git, Azure DevOps
    , and DBT (good to have).
  • Ensure optimal data quality and lineage by implementing proper testing, validation, and monitoring mechanisms within data pipelines.
  • Stay current with evolving data technologies, tools, and best practices, continuously improving standards, frameworks, and engineering methodologies.
  • Troubleshoot complex data issues, analyse system performance, and provide solutions to development and service challenges.
  • Coach, mentor, and support team members through knowledge sharing sessions, technical reviews.

Required Skills & Experience:

  • Developer / engineering background of large-scale distributed data processing systems (or experience in equal measure). Can provide constructive feedback based on knowledge.
  • Proficient in designing scalable and efficient data models tailored for analytical and operational workloads, ensuring data integrity and optimal query performance.
  • Practical experience implementing and managing Unity Catalog for centralized governance of data assets across Databricks workspaces, including access control, lineage tracking, and auditing.
  • Demonstrated ability to optimize data pipelines and queries using techniques such as partitioning, caching, indexing, and adaptive execution strategies to improve performance and reduce costs.
  • Programming in Pyspark (Must), SQL(Must), Python (Good to have).
  • Experience with Databricks (Mandatory) and DBT (Good to have) is required
  • Implemented cloud data technologies on either Azure (Must) other optional GCP, Azure or AWS.
  • Knowledge around shortening development lead time and improving data development lifecycle
  • Worked in an Agile delivery framework.

  • Senior Data Engineer

    4 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India Exact Mentoring Foundation Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Exciting Job OpportunityLocation: ThiruvananthapuramAre you a Data Engineer/Analyst with 2-5 years of experience? Work with MSSQL, Postgres, and data warehousing. Skilled in PowerBI/BigQuery for data analysis. Expert in Microsoft SQL Server (2016 & above) and SSIS for ETL processes. Familiarity with ML technologies. Excellent communication skills for all...

  • Senior Data Engineer

    10 hours ago

    Thiruvananthapuram, Kerala, India Litmus7 Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key ResponsibilitiesSilver/Gold Layer Development - Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables. - Apply business logic, standardization, and data quality checks.Partner with analysts and business stakeholders to validate metric definitions.Replatforming Support - Audit existing pipelines...

  • Senior Data Analyst

    5 days ago

    Thiruvananthapuram, Kerala, India Chalo Mobility Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a highly skilled Senior Data Analyst who can bridge data analysis with data engineering. The ideal candidate will have strong expertise in building data pipelines, driving reporting excellence, and mentoring junior analysts.Youll work closely with our product and development teams to deliver actionable insights, maintain data integrity,...

  • Senior Data Scientist

    1 week ago

    Thiruvananthapuram, Kerala, India Acsia Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Acsia Technologies is hiring for A Senior Data ScientistJob Location - Trivandrum (onsite)Exp - 5 + yrsPrefer immediate joinersWebsite - LinkedIn -  Acsia Technologies: Posts | LinkedInWe are seeking a hands-on and results-driven Sr Data Science Specialist with 5–10 years of experience in designing and implementing advanced analytical solutions. The...

  • Lead- Data Engineer

    4 days ago

    Thiruvananthapuram, Kerala, India UST Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    7 - 12 Years1 OpeningTrivandrumRole descriptionLead II - Software Engineering Who we are:At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 25 countries, we build for...

  • Data Engineer

    6 days ago

    Thiruvananthapuram, Kerala, India Tothr Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking dynamic candidate for the role of Data Engineer,who is proficient in Data Engineering,Fraud & Financial Crime Risk Management, Real-time Data Pipelines, Fraud Tools ,Python, SQL, Data Processing Frameworks and Machine Learning

  • Senior Data Analyst- Logistics

    7 days ago

    Thiruvananthapuram, Kerala, India ELEVARE BUSINESS SOLUTIONS PVT LTD - EBS Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Elevare Business Solutions is seeking a highly strategic and experienced Senior Data Analyst to join a prominent Australian Fourth-Party Logistics (4PL) leader in their Thiruvananthapuram office.This is a high-impact, senior commercial role focused on leveraging advanced data analytics to drive high-level profitability and optimize complex freight and...

  • data engineering faculty

    2 days ago

    Thiruvananthapuram, Kerala, India Edure Learning Full time ₹ 1,50,000 - ₹ 3,00,000 per year

    We are looking for a skilled and passionate Data Engineering Faculty to train and mentor students in modern data engineering concepts and tools. The ideal candidate should have hands-on experience in data pipelines, databases, cloud platforms, and big data technologies, along with a strong passion for teaching and student development.Key...

  • Architect - Data Engineering

    1 week ago

    Thiruvananthapuram, Kerala, India Guidehouse Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job FamilyData Science & Analysis (India)Travel RequiredUp to 10%Clearance RequiredNoneWhat You Will DoDesign and lead end-to-end architecture for modern, cloud-native data engineering, AI/ML and analytics platforms across the full data lifecycle, including ingestion, storage, transformation, and consumption.Architect high-performance data solutions using...