Big Data Engineer

4 weeks ago


Thiruvananthapuram, India Tata Elxsi Full time

Job Description :


- At least 4+ years of experience pyspark framework.

- Good experience writing complex SQL and No SQL databases.

- Excellent coding and design skills, particularly in Pyspark and Python.

- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).

- Experience in AWS technologies such as EC2, Redshift, Cloud formation, EMR, AWS S3, AWS.

- Experience designing and implementing data pipelines in a onprem/cloud environment is required.

- Experience building/implementing data pipelines using Databricks/On prem or similar cloud database.

- Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.

- Hands-on object-oriented programming experience using Python is required.

- Professional work experience building real-time data streams using Spark and Experience in Spark.

- AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data

(ref:hirist.tech)
  • Senior Data Engineer

    2 months ago


    Thiruvananthapuram, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan’s manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points. We are looking for Hands-On lead data engineer to build next...

  • Senior Data Engineer

    2 months ago


    thiruvananthapuram, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan’s manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points. We are looking for Hands-On lead data engineer to build next...


  • thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...


  • Thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, India Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, IN Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Senior Data Engineer

    2 months ago


    Thiruvananthapuram, India Nissan Motor Full time

    Description : We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program...

  • Senior Data Engineer

    2 months ago


    thiruvananthapuram, India Nissan Motor Full time

    Description : We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program...

  • Data Architect

    1 month ago


    Thiruvananthapuram, India Nissan Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Big Data Engineer

    2 months ago


    Bangalore,Chennai,Pune,Noida,Cochin,Kochi,Trivandrum,Thiruvananthapuram,Hyderabad, India SPG Consulting Solutions Pvt.Ltd Full time

    Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum. Job Description : - Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at...

  • Big Data Engineer

    1 month ago


    Bangalore/Chennai/Pune/Noida/Cochin/Kochi/Trivandrum/Thiruvananthapuram/Hyderabad, IN SPG Consulting Solutions Pvt.Ltd Full time

    Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at leveraging...


  • thiruvananthapuram, India CONNECTING 2 WORK Full time

    Job Description Responsibilities Below are some of the responsibilities an artificial intelligence, machine learning engineer is expected to assume in their position: Design and develop AI models to meet project requirements Convert AI/ML models into APIs that other developers can use Perform statistical analysis on big data sets ...

  • Data Engineer

    2 months ago


    Thiruvananthapuram, India ProPMO Services Private Limited Full time

    Job Description :We have a requirement for 3 Data Engineers who could join us on a short notice.3 to 8 years of professional software development/engineering experience.Specialist experience working in Python coding as a Data Engineer. Must have good experience working with databases PostgreSQL/MySQL/MS SQL.Must have good experience working in AWS/GCP...

  • Data Scientist

    6 days ago


    thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities:   • Utilize Python programming language to clean, transform, and manipulate large datasets for analysis. • Develop and implement statistical models, machine learning algorithms, and predictive analytics to solve complex business problems. • Apply advanced data mining techniques and statistical analyses to identify...

  • Senior Data Engineer

    2 months ago


    Thiruvananthapuram, India Quantiphi Full time

    Role: Senior Data EngineerExperience Level: 4 to 7 YearsWork location: Trivandrum (Hybrid Only)Required Skills:● Bachelor’s degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...

  • Senior Data Engineer

    2 months ago


    Thiruvananthapuram, India Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Freelance Interviewer

    3 weeks ago


    Thiruvananthapuram, India Futuremug Full time

    Skills Required : Strong expertise in Fivetran, including: Connectors: Configuring and managing Fivetran connectors to efficiently extract data from various sources. Transformations: Developing data transformations using SQL to cleanse, manipulate, and enrich data for analysis. Configurations: Optimizing Fivetran pipelines for performance and reliability. ...

  • Freelance Interviewer

    3 weeks ago


    Thiruvananthapuram, India Futuremug Full time

    Skills Required : Strong expertise in Fivetran, including:Connectors: Configuring and managing Fivetran connectors to efficiently extract data from various sources.Transformations: Developing data transformations using SQL to cleanse, manipulate, and enrich data for analysis.Configurations: Optimizing Fivetran pipelines for performance and...


  • thiruvananthapuram, India Antal International Full time

    Job Description UI SOFTWARE ENGINEER Exp: 4+ years “Reflections Engineers are innovators and problem-solvers, building solutions in risk management, big data, mobile and more. We look for creative collaborators who evolve, adapt to change and thrive in a fast-paced global environment. Change the world by connecting people and capital with ideas. Solve the...


  • Thiruvananthapuram, India UST Full time

    Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes: - Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data...