Senior Data Engineer

2 weeks ago

South Moti Bagh, India TGS The Global Skills Full time

Responsibilities :


- Hands on experience in data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scripts.


- Expert knowledge in AWS Data Lake implementation and support (S3, Glue, DMS Athena, Lambda, API Gateway, Redshift).


- Experiences in programming language Experience with data migration with hands-on experience.


- Experiences in consuming rest API using various authentication options with in AWS.


- Lambda architecture.


- Orchestrate triggers, debug and schedule batch job using a AWS Glue, Lambda and step functions.


- Hands-on experience with Redshift, including data models, storage, and writing effective queries.


- Understanding of AWS security features such as IAM roles and policies.


- Knowledge of the Devops tools and CI/CD process.


- AWS certification in AWS is highly Skills & Expertise :


Cloud (AWS) Expertise :


- S3 (Simple Storage Service) : Data storage and partitioning, lifecycle policies, data replication, encryption at rest and transit, and data versioning, Data archive and Data sharing mechanisms.


- Lambda : Creation of Lambdas, configuring event-driven functions, monitoring, and integration with other AWS services of s3,Glue,API Gateway, Redshift etc.


- Glue : Creating & Managing ETL pipelines, Glue crawlers, job scheduling, and integration with S3, Redshift, and Athena.


- Redshift : Creating Tables, Views and Stored procedures, parameter tuning, workload management, configuring triggers, Redshift Spectrum usage for querying S3 data.


- API Gateway : Designing Restful APIs, securing endpoints using IAM or Cognito, throttling and logging API usage.


- VPC (Virtual Private Cloud) : Aware of existing VPC design, subnets, NAT gateways, peering, routing, and network ACLs for services creation.


- ELB (Elastic Load Balancer) : Configuring ALB/NLB for load distribution, health checks, sticky sessions, and SSL termination.


- CloudTrail : Enabling auditing and compliance logging, managing trails, integrating with CloudWatch and third-party SIEM tools.


- SageMaker : Knowledge about Sagemaker ML model training and deployment workflows, managing notebooks, endpoints, and model & DevOps Tools :


- GitHub / GitHub Actions : Managing version control, branching strategies, and automating workflows for testing and deployment.


- Jenkins / CloudBees : Building pipelines for build-test-deploy automation, plugin management, parallel execution, and integrations with SCM and artifact repositories.


- SonarQube : Static code analysis, security vulnerability checks, technical debt reporting, integration into & AI/ML Awareness :


- Understanding of ML model lifecycle : data preprocessing, training, evaluation, deployment, and monitoring.


- Experience supporting Data Scientists and ML Engineers in deploying models to production.


- Familiarity with tools and workflows like SageMaker, MLflow, Airflow (optional), and pipelines Skills :


AWS Data Lake, Python/PySpark, SQL, AWS Lambda, Redshift, AWS Glue, Data Migration, IAM Security, CI/CD, AWS Certification.


(ref:hirist.tech)

  • Senior Executive

    6 hours ago

    South Moti Bagh, India Swiggy Full time

    Role: Site Engineer - Senior Executive Primary responsibility is to visit the shortlisted properties along with the BD Team for Project due diligence which involves (Site measurements and technical inspection) The Engineer fills the site validation checklist for any New/Relocation pods, The Engineer needs to draft the floor plan hand sketch in grid sheet...

  • Senior Engineer Communications(Long Range

    2 weeks ago

    Bangalore (South), India FLYING WEDGE DEFENCE & AEROSPACE Full time

    We're Hiring | Senior Engineer – Communications (Long Range & Satcom) Bengaluru, India | Full-time About Us Flying Wedge Defence and Aerospace designs & manufactures unmanned aircraft systems (UAS) from 10–800 kg, delivering cutting-edge defence and aerospace solutions. Role We are looking for a Senior Engineer – Communications with deep expertise in...

  • Senior Azure DevOps Engineer

    2 weeks ago

    Bangalore (South), India Xebia Full time

    Company Description Xebia is a leading authority in digital transformation, partnering with top global companies to build resilient organizations and foster digital leadership. We offer services in Applied & GenAI, Data and Cloud, Intelligent Automation, and Digital Products & Platforms. Our specialized training programs and innovative solutions help clients...

  • Senior Software Engineer

    2 weeks ago

    Bangalore (South), India TESCRA Full time

    Senior Software Engineer(Ab Initio) Work Location: Bangalore Employment Type: Full-Time Opening : 3 Experience : 8-12 Yrs Share your profile at Job Summary: Timeline: Immediate joiners only We're interested in hearing from people who Have solid hands-on experience of #dataengineering/ ETL principles and practices with Unix /Linux, AbInitio and other data...

  • Senior Engineer Communications(Long Range

    5 days ago

    Bengaluru South, Karnataka, India FLYING WEDGE DEFENCE & AEROSPACE Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're Hiring | Senior Engineer – Communications (Long Range & Satcom)Bengaluru, India | Full-timeAbout UsFlying Wedge Defence and Aerospace designs & manufactures unmanned aircraft systems (UAS) from 10–800 kg, delivering cutting-edge defence and aerospace solutions.RoleWe are looking for a Senior Engineer – Communications with deep expertise in...

  • Senior Software Engineer Backend

    2 weeks ago

    Bangalore (South), India Impact Analytics Full time

    Company Description Impact Analytics delivers AI-native SaaS solutions and consulting services to help companies maximize profitability and customer satisfaction through deeper data insights and predictive analytics. With a fully integrated, end-to-end platform for planning, forecasting, merchandising, pricing, and promotions, Impact Analytics empowers...

  • AWS Data Engineer

    2 weeks ago

    Bangalore (South), India Vtricks Technologies Full time

    Job Title: AWS Data Engineer Location:Bangalore (Hybrid) Experience:3–5 years About Us DataZymes is a data-driven company committed to empowering organizations with actionable insights through advanced analytics and business intelligence solutions. Join our growing team that valuesinnovation, collaboration, and excellence. Key Responsibilities Design and...

  • Senior Software Engineer

    2 weeks ago

    Bangalore (South), India Havisoft Consultancy Services Full time

    Title: Software Senior Engineer Location: Bangalore Skills:  Vendavo framework (OMI, UII, and VSL), core Java, Database (Oracle) Overall Experience: 5-8 years' experience Relevant exp: 5+ years Duration: 4 years project immediate joiners only Interview: 2 rounds of virtual interviews

  • Senior Azure DevOps Engineer

    3 days ago

    Bengaluru South, Karnataka, India Xebia Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionXebia is a leading authority in digital transformation, partnering with top global companies to build resilient organizations and foster digital leadership. We offer services in Applied & GenAI, Data and Cloud, Intelligent Automation, and Digital Products & Platforms. Our specialized training programs and innovative solutions help clients...

  • Senior Software Engineer

    1 day ago

    Bengaluru South, Karnataka, India TESCRA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Software Engineer(Ab Initio)Work Location: BangaloreEmployment Type: Full-TimeOpening : 3Experience : 8-12 Yrs Share your profile at Job Summary:Timeline: Immediate joiners onlyWe're interested in hearing from people whoHave solid hands-on experience of #dataengineering/ETLprinciples and practices withUnix/Linux,AbInitioand other data integration...