Senior Data Engineer

11 hours ago

Thiruvananthapuram Kerala India, Kerala Us Technology International Private Limited Full time

Senior Data Engineers

Experience - 6 +Yrs (5-7 relevant years)

Location: Trivandrum

Mandatory Skill - Pyspark, SQL, Azure Databricks

UK Shift Timing

Job Description –

Key Accountabilities / Responsibilities:

  • Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality.
  • Review and optimize PySpark, SQL, and Databricks code for performance, scalability, and maintainability.
  • Offer engineering support and mentorship to data engineering teams within delivery squads, guiding them in building robust, reusable, and secure data solutions.
  • Collaborate with architects to define data ingestion, transformation, and storage strategies leveraging Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lakes
  • Drive automation and CI/CD practices in data pipelines using tools such as Git, Azure DevOps, and DBT (good to have).
  • Ensure optimal data quality and lineage by implementing proper testing, validation, and monitoring mechanisms within data pipelines.
  • Stay current with evolving data technologies, tools, and best practices, continuously improving standards, frameworks, and engineering methodologies.
  • Troubleshoot complex data issues, analyse system performance, and provide solutions to development and service challenges.
  • Coach, mentor, and support team members through knowledge sharing sessions, technical reviews.

Required Skills & Experience:

  • Developer / engineering background of large-scale distributed data processing systems (or experience in equal measure). Can provide constructive feedback based on knowledge.
  • Proficient in designing scalable and efficient data models tailored for analytical and operational workloads, ensuring data integrity and optimal query performance.
  • Practical experience implementing and managing Unity Catalog for centralized governance of data assets across Databricks workspaces, including access control, lineage tracking, and auditing.
  • Demonstrated ability to optimize data pipelines and queries using techniques such as partitioning, caching, indexing, and adaptive execution strategies to improve performance and reduce costs.
  • Programming in Pyspark (Must), SQL(Must), Python (Good to have).
  • Experience with Databricks (Mandatory) and DBT (Good to have) is required
  • Implemented cloud data technologies on either Azure (Must) other optional GCP, Azure or AWS.
  • Knowledge around shortening development lead time and improving data development lifecycle
  • Worked in an Agile delivery framework.

  • Senior Data Engineer

    6 days ago

    Thiruvananthapuram, Kerala, India Us Technology International Private Limited Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob DescriptionKey Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End...

  • Senior Data Engineer

    3 days ago

    Thiruvananthapuram, Kerala, India Armada Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Job We are seeking a highly motivated Senior Data Engineer to join our Data Platform team for our Edge Computing AI Platform.  As a Data Engineer in our Data Platform team, you will be responsible for helping us shape the future of data ingestion, processing, and analysis, while maintaining and improving existing data systems.  If you are a...

  • Senior Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India Appfabs Incorporation Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Senior Data Scientist

    11 hours ago

    Thiruvananthapuram, Kerala, India, Kerala Allianz Services Full time

    Designation - Senior Data Scientist Experience Range - 5 to 10 YearsLocation - TrivandrumWork Mode - Work from office Shift time - 07:30 Am to 04:30 pm KEY REQUIREMENTS -A degree in a highly quantitative field such as Computer Science, Mathematics, Statistics or equivalent, postgraduate studies preferredDemonstrated experience in a Data Scientist role,...

  • Data Engineer

    2 weeks ago

    Thiruvananthapuram, Kerala, India Exact Mentoring Foundation Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Exciting Job OpportunityLocation: ThiruvananthapuramAre you a Data Engineer/Analyst with 2-5 years of experience? Work with MSSQL, Postgres, and data warehousing. Skilled in PowerBI/BigQuery for data analysis. Expert in Microsoft SQL Server (2016 & above) and SSIS for ETL processes. Familiarity with ML technologies. Excellent communication skills for all...

  • Senior Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Senior Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India Litmus7 Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key ResponsibilitiesSilver/Gold Layer Development - Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables. - Apply business logic, standardization, and data quality checks.Partner with analysts and business stakeholders to validate metric definitions.Replatforming Support - Audit existing pipelines...

  • Senior Data Analyst

    2 weeks ago

    Thiruvananthapuram, Kerala, India Chalo Mobility Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a highly skilled Senior Data Analyst who can bridge data analysis with data engineering. The ideal candidate will have strong expertise in building data pipelines, driving reporting excellence, and mentoring junior analysts.Youll work closely with our product and development teams to deliver actionable insights, maintain data integrity,...

  • Senior Data Engineer for Trivandrum

    3 days ago

    Thiruvananthapuram, Kerala, India VAMS Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company Description VINIRMAConsulting Pvt. Ltd.is a 360-degree Human Resource Management Consulting and StaffingServices Organization with operations in UAE, Qatar, Bahrain,Australia, USA, Singapore & India. Job Description VINIRMAConsulting Pvt. Ltd.is a 360-degree Human Resource Management Consulting and StaffingServices Organization with operations in...