Big data Spark Scala Back-End Engineer

5 days ago

Jamnagar, India Tata Consultancy Services Full time

I hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS.Job Title: Scala Back-End Engineer Locations: Bangalore, IndiaMode: Full Time 8-16 Years Experience About the Role:We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.Responsibilities:Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.Work with Data Frames to manipulate and analyse large datasets.Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).Build and maintain real-time data streaming pipelines using MSK/Kafka.Utilize S3 for data storage and retrieval.Work with data lake technologies like Iceberg.Ensure data quality, integrity, and security.Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.Participate in code reviews and contribute to improving our development processes.Troubleshoot and resolve issues in data pipelines and back-end systems.Qualifications:Bachelor’s degree in computer science or a related field (or equivalent experience).5+ years of experience in back-end development with a focus on data engineering.Required Skills:Strong proficiency in Spark, Python, Scala, and Java.Expertise in SQL and working with relational databases.Experience with DataFrames for data manipulation and analysis.Experience with cloud technologies (preferably AWS or GCP).Experience with message streaming platforms like MSK/Kafka.Experience with S3 or similar object storage.Experience with data lake technologies like Iceberg.Solid understanding of data warehousing concepts.Excellent communication and collaboration skills.Bonus Points:Experience with data modelling and schema design.Experience with data governance and data quality management.Experience with DevOps practices and CI/CD pipelines.Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).

  • Senior Data Scientist SME

    2 days ago

    Jamnagar, India Information Tech Consultants Full time

    Senior Data Scientist SME & AI Architect (10+ Years Experience)We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep technical mastery across large-scale Big Data technologies,...

  • Azure data engineer

    2 weeks ago

    Jamnagar, India SystemBender Full time

    *Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with Py Spark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (Py Spark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Scala Developer

    3 weeks ago

    Jamnagar, India Tata Consultancy Services Full time

    Role* Scala Developer *****Exp -4to 8 YearsPlease read Job description before ApplyingNOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization...

  • Senior Data Engineer

    3 weeks ago

    Jamnagar, India Egen Full time

    Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data...

  • Back end developer

    2 weeks ago

    Jamnagar, India OPTIMAS.AI Inc Full time

    Designation: Back-end Engineer — Nest JS / Type Script (1–3 yrs) Job Location: Permanent Work from Home (The office location is in Bangalore, but Permanent Work from Home is being provided to all employees. Candidates anywhere in India can apply.) Experience: 1 - 3 years Notice period: Immediate joiner or a maximum of 30 days Role summary: Own APIs,...

  • Software Engineer/Senior Software Engineer/Technical Lead

    4 weeks ago

    Jamnagar, India Crest Data Full time

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key Responsibilities -- Responsible for providing expertise in...

  • Fullstack engineer

    3 weeks ago

    Jamnagar, India Sonata Software Full time

    Greetings We are hiring Fullstack Dotnet Developers. Please find below the JD and send your profile to /Gladwyn. Sonata Software Overview: In today's market, there is a unique duality in technology adoption. On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefronts to attract more...

  • Java Software Engineer

    4 weeks ago

    Jamnagar, India Cube Consultancy Services Full time

    Tech StackBackend & Infra:Java (Spring Boot), Microservices, AWS ECS, Redis, ScyllaDB, MongoDB, GraphQL, AWS, Lambda, SQS Data & AI:Databricks, Spark, Kinesis, Claude, Cursor, LangChain Observability:Prometheus, Grafana, CloudWatchRole: Senior Backend Engineer (Java / Microservices) We’re hiring an experienced backend engineer (4-10 years of experience) to...

  • Data Engineer

    6 days ago

    Jamnagar, India Kanerika Inc Full time

    Who we are: Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge...

  • Senior data engineer/architect

    2 weeks ago

    Jamnagar, India HARP Full time

    Mandatory skills- Python+ Azure Databricks + SQL (all are mandatory skills) Key responsibilities : Build reusable utilities , templates, and automation pipelines. Design scalable data engineering frameworks , standards, and best practices. Provide architectural guidance, cost optimization and performance tuning support for Data Engineering solutions (mainly...