Big Data Engineer

1 month ago

Delhi, India TekJobs Full time
This role is for a Data Engineering Lead to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value.

Job Background/context:

The technology team is responsible for building and maintaining a multitude of applications including:

Real-time ingestion/stream processing and data distribution via Big Data APIsBuild out canonical models and data conformanceImplement best-in-class data management and data ingestion.Leverage new storage engines like Kudu that enable analytics on fast-changing dataLeverage GPU implementation to enable advanced Machine LearningEnhance Self-Service capability for data science and ML practitioners

This is a hands-on development role that will offer exposure to the full development cycle, whilst working closely with our business and technology stakeholders.

Analysis and development across Lines of business including Payments, Digital Channels, Liquidities, TradeCross-train and fertilize functional and technical knowledge,Align to Engineering Excellence Development principles and standards.Promote and increase our Development Productivity scores for codingFully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline

Development Value:This role would open career opportunities for the successful individual to establish their profile in the Data Innovation and Architecture organization.

It provides an opportunity in Institutional Client banking to work closely with the business to provide valuable data solutions

Knowledge/Experience:· 5+ years of experience in Hadoop/big data technologies.

· 3+ years of hands-on experience as a Scala developer (with a previous Java background)

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event-based messaging

· Experience with API development and use of JSON/XML/Hypermedia data formats

· Relational and NoSQL database integration and data distribution principles experience

· Unix/Linux

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Advanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)

· Knowledge of agile(scrum) development methodology is a plus

· Strong development/automation skills

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

Qualifications:Strong academic record, ideally with a good degree and a mathematical or scientific background.

· Strong Communication skills

· Self Motivated

· Willingness to learn

· Excellent planning and organizational skills

  • Big Data Engineer

    1 month ago

    Delhi, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Data Engineer

    2 weeks ago

    Delhi, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Role: Data EngineerExperience: 2+YearsNotice period: ImmediateLocation: Anywhere from IndiaJob Type: Full TimeResponsibilities:Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations & data governanceResponsible for...

  • Freelance Big Data Engineer

    1 month ago

    Delhi, India Leading MNC Full time

    Looking for aFreelance Big Data Solutions Engineerto join a team of rockstar developers. The candidate should have aminimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Freelance Big Data Engineer

    1 month ago

    delhi, India Leading MNC Full time

    Looking for a Freelance Big Data Solutions Engineer to join a team of rockstar developers. The candidate should have a minimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...

  • Data Engineer –

    1 month ago

    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Architect : Big Data

    2 weeks ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Architect : Big Data

    1 week ago

    New Delhi, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Architect : Big Data

    2 weeks ago

    new delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Architect : Big Data

    2 weeks ago

    New Delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Big Data Hadoop

    1 month ago

    Delhi, India SAM Manpower and Career Services Full time

    Job Description **Job Description**: Contract Exp - 4+ Location Delhi Hybrid Big Data,hadoop **Requirements**: Big Data,hadoop About Company / Benefits IT MNC **Role**: Big Data Hadoop **Location**: Delhi, India **Work Exp.**: 4-6 Years **Job Type**: Full Time **Salary**: INR 0-0 **Equity**: 0% - 0%

  • Operations Specialist

    6 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    6 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Architect : Big Data / Ml

    1 month ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • ▷ (25/05/2024) Operations Specialist

    6 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Big Data Developer

    5 hours ago

    delhi, India Impetus Full time

    Experience Required: 4-5 yrs.Location: GurgaonImmediate Joiners onlyJOB DESCRIPTION:Skillset:Should have strong experience in big data technologies.Basic skills in data pipeline – experience in building data pipelines for data migrationBig Data – Pyspark, SparkStrong command on SQL & HiveProgramming Language: Any - Java/Python/Scala

  • Senior AWS Data Engineer

    2 weeks ago

    delhi, India LevelUP HCS Full time

    AWS Data Engineer- KafkaWe are looking for a Data Engineer (AWS Data Platform) to join our busy and dynamic business intelligence – data platform team.If you are a passionate Data Engineer you have the chance to be part of a team that looks to build out our next-generation data platform, leveraging new technologies and techniques to maximize the business...

  • Big Data Engineer

    3 days ago

    delhi, India OmegaHires Full time

    Job Title: Big Data Engineer (Cornerstone to Lumi migration) Duration: Full-time on OmegaHires Payroll  Location: NCR (Hybrid - 3 days Onsite per week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • ETL Big Data

    2 days ago

    new delhi, India LTIMindtree Full time

    Hi AllLooking for ETL Big data testerExperience- 3-8Location-ChennaiWorking experience in Big Data Testing or ETL TestingVery Good in SQL or HiveGood in LinuxWell versed in Agile processShould work independently and interact with customerBig Data Application Knowledge and Tele com background would be an added advantage

  • Solutions Architect

    1 month ago

    Delhi Cantonment, Delhi, Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Big Data Developer

    3 weeks ago

    delhi, India HTC Global Services Full time

    The project team will be spread between Paris and Bangalore. So, the candidate with an experience of 4-7 years is expected to work and coordinate on daily basis with the remote teams. Ability to learn new technology / framework / methodology.• Hands-on individual responsible for producing excellent quality of code, adhering to expected coding standards...