Big Data Engineer

1 month ago


Bangalore, Karnataka, India randstad Full time

Primary Responsibilities :

- Design, develop, and implement big data solutions using Java, Python, or Scala.

- Utilize SQL and Spark Scala for data processing and analysis.

- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.

- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and retrieval.

- Develop and maintain applications using frameworks like Java/J2EE, Spring Boot, and cloud frameworks.

- Implement infrastructure as code using Terraform and Cloud Formation for cloud resources provisioning and management.

- Collaborate with cross-functional teams to define, design, and deliver big data solutions.

- Participate in Agile/Scrum methodologies, contributing to sprint planning, daily stand-ups, and retrospectives.

- Troubleshoot and optimize existing big data pipelines and applications for performance and scalability.

Key Skills and Qualifications :

- Bachelor's/Master's degree in Computer Science, Information Technology, or a related field.

- Experience in Java, Python, or Scala for big data processing and analytics.

- Proficiency in SQL and Spark Scala for data manipulation and querying.

- Hands-on experience with AWS services such as S3, EC2, and Lambda.

- Experience with databases like Postgres, MySQL, Oracle, etc.

- Knowledge of Java/J2EE, Spring Boot, and cloud frameworks.

- Familiarity with Terraform and Cloud Formation for infrastructure management.

- Strong understanding of Agile/Scrum methodologies.

- Excellent problem-solving, analytical, and communication skills.

Salary : 15-25LPA

(ref:hirist.tech)
  • Big Data Engineer

    1 month ago


    Hyderabad/Bangalore, Karnataka, India HRwing Full time

    Role & Responsibilities:Good development practices:Hands on coder with good experience in programming languages like Java or Python.Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.Good understanding of programming principles and development practices like checkin policy, unit testing, code deploymentSelf...

  • Principal Engineer

    1 month ago


    Bangalore, Karnataka, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    What Success Will Look Like :- Design, build and maintain the stream processing, time-series analysis system which is at the heart of Data Platform's products- Responsible for architecture of the platform- Build features, enhancements, new services and bug fixing in Scala and Rust on a Jenkins based pipeline to be deployed as Docker containers on...

  • Engineering Manager

    1 month ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Mandatory requirements :- Apache Kafka- Elastic search- Spark Spring- NoSql- Swift- Distributed systems and Java (preferred)- Only from product organisationsResponsibilities : - Manage software development projects by setting requirements, goals and timelines. - Create clear career paths for team members and help them grow with regular & deep mentoring....

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India GLAXOSMITHKLINE ASIA PVT. LTD Full time

    A new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...

  • Data Scientist

    1 month ago


    Bangalore, Karnataka, India SGS consulting Full time

    Role : Data Scientist Skills : AI/ML- PythonData visualization tools : Tableau, Matplotlib, SeabornExperience Required : 4-5 yearsLocation : Bangalore (WFO)N.P : Immediate to 15 daysObjectives of this role :- Collaborate with product design and engineering teams to develop an understanding of needs- Research and devise innovative statistical models for data...

  • Data Engineer

    1 week ago


    Bangalore, Karnataka, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India D Square Consulting Service Full time

    Role : Sr. Data Engineer DOMOExperience : 5+ YearsLocation : Bangalore- Candidates who can join within 30 days, may only applyWorking Mode : Work From OfficeJob Highlights :Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital marketing projects.- Strong knowledge of digital marketing toolsPreferred...

  • Python Developer

    1 month ago


    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Juego Studios

    3 weeks ago


    Bangalore, Karnataka, India Juego Studios Full time

    As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the...


  • Bangalore, Karnataka, India Pluralsight Full time

    Job Description : Working at Pluralsight Founded in 2004 and trusted by Fortune 500 companies, Pluralsight is the technology skills platform organizations and individuals in 150+ countries count on to create progress for the world. Our platform helps technologists master their craft and take control of their careers. We empower businesses everywhere to build...


  • Bangalore, Karnataka, India Connectpro Mgmt Pvt Ltd Full time

    Data Science ArchitectMust Have :- PhD in any of the quantitative sciences like Mathematics, Statistics, Computer science etc.- 20+ years of relevant experience of working with enterprise datasets matching big-data definitions. - Minimum 5 plus years of building a centre of excellence for data analytics, predictive and prescriptive analytics- At least 10...

  • Akaike Technologies

    3 weeks ago


    Bangalore, Karnataka, India Akaike Technologies Full time

    About the job : At Akaike Technologies, we foster unique career paths with an inclusive culture, extensive support, and cutting-edge technology. Join our team to shape the future with Vision AI and positively impact the quality of life on our planet.Responsibilities : - Analyse raw data : assessing quality, cleansing, and structuring for downstream...

  • Data Engineer

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India Indium Software Full time

    Job Description:We are seeking a talented and motivated Data Engineer to join our team. The ideal candidate should have a strong background in SQL, Python, ETL, and data visualization, with experience working closely with stakeholders and providing data support to Data Analysts. As a Data Engineer, you will play a key role in developing data pipelines,...


  • Bangalore, Karnataka, India BOOTLABS TECHNOLOGIES PRIVATE LIMITED Full time

    Responsibility :- At least 4 years of experience in AWS technologiesThe documented ability of delivering innovative solutions in an applied environment related to at least one of the following areas :- ETL, Data pipeline, Workflow- Strong knowledge of programming in Python, Java, or Scala.- High level of competence in global and cross-skilled collaborative...


  • Bangalore, Karnataka, India BOOTLABS TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :- At least 3 years of experience in AWS technologies- The documented ability of delivering innovative solutions in an applied environment related to at least one of the following areas : ETL, Data pipeline, Workflow- Strong knowledge of programming in Python, Java, or Scala.- High level of competence in global and cross-skilled collaborative...

  • Test Engineer

    1 month ago


    Bangalore, Karnataka, India Ara Resources Pvt Ltd Full time

    About The Company :ARA's client is a leading, high growth Software Development company developing products that touch and positively impact human lives across the globe. We are headquartered in New Jersey and have a software development center in Bangalore. Our work is mainly focused on Healthcare Industry. We develop core data science products that help...

  • Senior Data Analyst

    1 week ago


    Bangalore, Karnataka, India Yitro business consultants Full time

    Job Description:Powerful predictors of the future, our Analytics team blends data science and business intelligence to enable extra foresight for our platform offerings. They connect insights to results for our clients by working closely with senior stakeholders, staying in tune with market trends, and with the power of our big data assets. By leveraging new...


  • Bangalore, Karnataka, India Luxoft Full time

    What you will need:- 6+ years in Site Reliability role (DevOps/System Administration) maintaining Linux systems in cloud environments (We use AWS)- Excellent understanding of Linux systems and Network Fundamentals- Deep understanding of Monitoring and Alerting systems such as Prometheus, Graphite, or equivalent- Experience with infrastructure automation...

  • Kaivale Technologies

    3 weeks ago


    Bangalore, Karnataka, India Kaivale Technologies Full time

    You will spend time ensuring the products have the best technical design and architecture; you would be supported by peers and team members in creating best-in-class technical solutions.Identify technical challenges proactively and provide effective solutions to overcome them, ensuring the successful implementation of features and functionality.Quickly...


  • Bangalore, Karnataka, India Freelancer Recruiter Full time

    Desired Skills & Qualifications :- Deep understanding of algorithms and data structures.- Should have worked with MVC frameworks, web / client based server architecture, structured and unstructured databases.- Ability to translate product spec to engineering actionables.- Ability to navigate and structure code bases.- Rudimentary skills around service...