Big data Spark Scala Back-End Engineer

7 days ago

Thrissur, India Tata Consultancy Services Full time

I hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS. Job Title: Scala Back-End Engineer Locations: Bangalore, India Mode: Full Time 8-16 Years Experience About the Role: We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India. Responsibilities: - Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java. - Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes. - Work with Data Frames to manipulate and analyse large datasets. - Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP). - Build and maintain real-time data streaming pipelines using MSK/Kafka. - Utilize S3 for data storage and retrieval. - Work with data lake technologies like Iceberg. - Ensure data quality, integrity, and security. - Collaborate with data scientists and other engineers to understand data requirements and deliver solutions. - Participate in code reviews and contribute to improving our development processes. - Troubleshoot and resolve issues in data pipelines and back-end systems. Qualifications: Bachelor’s degree in computer science or a related field (or equivalent experience). 5+ years of experience in back-end development with a focus on data engineering. Required Skills: - Strong proficiency in Spark, Python, Scala, and Java. - Expertise in SQL and working with relational databases. - Experience with DataFrames for data manipulation and analysis. - Experience with cloud technologies (preferably AWS or GCP). - Experience with message streaming platforms like MSK/Kafka. - Experience with S3 or similar object storage. - Experience with data lake technologies like Iceberg. - Solid understanding of data warehousing concepts. - Excellent communication and collaboration skills. Bonus Points: - Experience with data modelling and schema design. - Experience with data governance and data quality management. - Experience with DevOps practices and CI/CD pipelines. - Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).

  • Etl architect

    6 days ago

    Thrissur, India Tata Consultancy Services Full time

    Position- ETL Architect Location- Bengaluru, chennai Experience- 8 to 11 Years Notice period- 0 to 6 o Days or Serving NP Job Description 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices. 6+ years Data Warehouse/Data Lake Architecture and...

  • Azure Data Engineer-Technical Lead

    7 days ago

    Thrissur, India Sigmoid Full time

    Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Azure Data Engineer-Technical Lead

    7 days ago

    Thrissur, India Sigmoid Full time

    Kindly find the Job Description Below.Job Title:Technical Lead-Azure Data EngineerLocation: BangaloreYears of Experience: 10+ years of experienceSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data engineer

    3 weeks ago

    Thrissur, India Philodesign Technologies Inc Full time

    Job Title: Data Engineer Experience: 6–8 Years Work Mode: Remote (9 AM – 5 PM EST) Employment Type: Full-time Notice Period: Immediate Joiner About the Role We are seeking an experienced Data Engineer to design, develop, and implement robust data exchange and processing solutions using Azure technologies. The ideal candidate will have strong hands-on...

  • Machine Learning Engineer

    2 days ago

    Thrissur, India ADP Full time

    Total Experience : 8-12yearsLocation : HyderabadNotice Period : Immediate to 30days onlyPosition : 1We're seeking a talented ML Engineer to help build, deploy, scale and maintain machine learning models and optimize our ML workflows and infrastructure.Key ResponsibilitiesDesign and develop high-performance, scalable, and reliable machine learning pipelines...

  • Machine Learning Engineer

    2 days ago

    Thrissur, India ADP Full time

    Total Experience : 8-12yearsLocation : HyderabadNotice Period : Immediate to 30days onlyPosition : 1We're seeking a talented ML Engineer to help build, deploy, scale and maintain machine learning models and optimize our ML workflows and infrastructure.Key ResponsibilitiesDesign and develop high-performance, scalable, and reliable machine learning pipelines...

  • Azure Backend Engineer

    1 week ago

    Thrissur, India Big Rattle Technologies | Big Rattle AI Full time

    Position: Azure Backend Engineer (.NET Developer) (8 - 10 years)Location: Remote (Company in Mumbai)Company: Big Rattle Technologies Private LimitedImmediate Joiners only.We are seeking an experienced Software Engineer proficient in modern .NET (8 or higher), Microsoft Azure, and Terraform to join our team in building scalable backend cloud solutions. You...

  • Senior Data Engineer

    2 weeks ago

    Thrissur, India American Inference Full time

    Note: Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: - Consulting Services: AI Strategy,...

  • Java/Python Developer

    3 weeks ago

    Thrissur, India IKAI Technology Solutions Full time

    Company DescriptionIKAI Technology Solutions supports businesses worldwide in harnessing the potential of information technology. Serving North America, Europe, and Asia-Pacific regions, we specialize in empowering enterprises to navigate the digital landscape with innovative solutions. With a strong commitment to learning and growth, IKAI fosters continuous...

  • Sr. data architect

    2 days ago

    Thrissur, India TUTOADDA Full time

    Senior Data Architect – SnowflakeLocation: Trivandrum / Kochi (Hybrid / Remote Flexibility) Experience: 10+ Years Budget: Up to ₹30 LPA Notice Period: Immediate Joiners Preferred Working Hours: 12 PM – 9 PM IST (Mandatory EST Overlap) We are looking for an experienced Senior Data Architect with strong expertise in Snowflake, enterprise data...