Big Data Developer

4 weeks ago

Bangalore, India Luxoft Full time

Project Description:

The Cirrus project is developing cloud-based compliance state-of-the-art archive products to archive and retain real-time communications data in line with internal and external regulatory requirements. The product is developed in-house in an agile development setup, based on business requirements from multiple stakeholder parties. By employing continuous development and deployment principles, the team is aiming to transition from project to product management to support the bank with a robust compliance archive solutions for the next decade. For a large global investment bank, we are looking for GCP-qualified cloud engineers to help with the FIC (fixed income and currencies) cloud migrations under project Cirrus.

Knowledge of Financial Services/FIC would be great - but the primary skills we need are in building, migrating, and deploying applications to GCP, terraform module coding, google infrastructure, cloud-native services such as GCE, GKE, CloudSQL/Postgres, logging, and monitoring, etc. & good written and spoken English, as we would like these engineers to help with knowledge transfer to our existing development & support teams.

We would like to place people alongside the engineers they'll be working with in the bank.

Responsibilities:

  • Creation of a robust solution design that supports all functional and non-functional requirements
  • Assist in the creation of automated testing tooling that will reduce the time spent on manual testing
  • Assist in the creation of DevOps tooling to establish strong automation for the software build and deployment processes
  • Follow bank processes and use industry-standard tools for implementation and productization of software
  • Involvement at all stages of SDLC: analysis, design, development, unit and integration testing, UAT facilitation, packaging, and deployment
  • Cooperation with other development teams, functional analysts, business analysts, and numerous stakeholders of the project, as appropriate for the area of work

Mandatory Skills Description:

  • 7+ years of experience in Big Data technologies
  • 3+ years of Extensive experience with Big Data technologies/engineering (Hadoop, HDFS, MapReduce, and other big data tools)
  • Handling data and persistence of data using databases, key-value stores (SQL, NoSQL)
  • Data streaming pipelines employing Kafka, Spark
  • Design/implementation of reporting solutions using Big Data technologies
  • Build tools like Maven, Gradle
  • Testing tools like Postman, curl, JUNIT, Mockito
  • Strong coding methodologies, design patterns, and best practices
  • Strong ability to work independently, propose architectural solutions, create prototypes, and deliver necessary technical documentation
  • Ability to work on collaboration with local and external teams
  • Relational and object databases like MongoDB, Sybase
  • Experience with CI (Continuous Integration) tools (Jenkins) and code quality (e.g., SonarQube), Code Coverage, Unit tests, etc.
  • Linux administration and maintenance, including bash scripts
  • Solid understanding of networking, DNS management, and firewall policies
  • Queue systems such as RabbitMQ, Apache ActiveMQ, Apache Kafka
  • Alerting and monitoring for cloud platform with tools such as Kibana, Grafana

In addition, we seek someone with experience in developing reporting solutions on a data lake such as HDFS :

  • Scala developer with Hadoop/HDFS knowledge is a must
  • Experiencing of hosting data on HDFS
  • Experience in writing reporting services on data in HDFS
  • Familiarity or experience with the following tools: Dremio/SPARC/Notebook/Tableau

You should also be or have:

  • Ability to provide technical expertise with a focus on efficiency, reliability, scalability, and security; including planning, evaluating, recommending, designing, operationalizing, and supporting solutions in compliance with enterprise and industry standards.
  • Ability to plan, evaluate, recommend, design, operationalize, and support solutions in compliance with enterprise and industry standards.
  • Ability to lead and help team members on technical implementations.
  • Ability to work on multiple initiatives at the same time
  • Familiar with Agile, and SDLC processes

Nice-to-Have Skills Description:

  • Advanced full-stack Java programming skills
  • Domain knowledge in Investment Banking & Trading (ideally FX Options) will be advantageous
  • Strong analytical and technical background with good problem-solving skills
  • Good team-working and communication skills
  • Willing to go the extra mile to achieve team objectives

  • Big Data Developer

    3 weeks ago

    Bangalore, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: Remote Experience: 5+ years Job Type: Contractual Remote About Us: We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    3 weeks ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and Mumbai Experience : 5 to 14 years Relevant : should be 4+ yrs for Junior and 7+ yrs for Senior Primary skills : Spark, SQL,Hive Develop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    3 weeks ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    3 weeks ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big data developer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore/Chennai/Hyderabad/Pune Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in...

  • Big Data Developer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore/Chennai/Hyderabad/Pune Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in Big Data,...

  • Big Data Developer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    3 weeks ago

    Bangalore, India LTIMindtree Full time

    Please fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA

  • Senior big data developer

    1 month ago

    Bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Big Data Developer

    2 months ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...

  • Senior Big Data Developer

    2 months ago

    bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Senior Big Data Developer

    2 months ago

    bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Big data developer

    4 weeks ago

    Bangalore, India Luxoft Full time

    Project Description: The Cirrus project is developing cloud-based compliance state-of-the-art archive products to archive and retain real-time communications data in line with internal and external regulatory requirements. The product is developed in-house in an agile development setup, based on business requirements from multiple stakeholder parties. By...

  • Big Data Developer

    4 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role: Big Data Developer Location: Bangalore/Chennai/Hyderabad/Pune Experience:5-10 Years Required Technical skills: Bigdata, Hadoop Technologies 4+ years of experience in Big...

  • Big Data Developer

    4 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    3 weeks ago

    Bangalore, India Pixomania Full time

    As a Big Data Developer, you will design, develop, and optimize distributed data processing systems using Apache Spark and Hive. You will work on large-scale data platforms and ensure the efficient processing of massive datasets in real-time and batch environments. Your experience with Kafka will be an added advantage in building robust and scalable...

  • Big Data Developer

    4 weeks ago

    Bangalore, India Luxoft Full time

    Project Description: The Cirrus project is developing cloud-based compliance state-of-the-art archive products to archive and retain real-time communications data in line with internal and external regulatory requirements. The product is developed in-house in an agile development setup, based on business requirements from multiple stakeholder parties. By...

  • Senior big data developer

    1 month ago

    Bangalore City, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Big Data Developer

    4 weeks ago

    Bangalore, India Grid Dynamics Full time

    Note - Candidate should be an Immediate joiner or within 30 days. This is a Hybrid position in Bangalore (Only Local candidates will be considered for this role or some who can relocate in a day or two) Details required: (Share your resume to with below details for faster response) Total Years of experience - Notice period - CTC - Expected CTC - ...

  • Big Data Engineer

    2 months ago

    Bangalore, India Draup Full time

    Job Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...