See more Collapse

BigData Engineer

3 months ago

chennai, India Fractal Full time

It's fun to work in a company where people truly BELIEVE in what they are doing

The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and in building end-to-end productionized MLOps pipelines.

RESPONSIBILITIES:

Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you. You would be responsible for evaluating, developing, maintaining, and testing big data solutions for advanced analytics projects. The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights. The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction. An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.

QUALIFICATIONS:

Demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions. Ideally, this would include work on the following technologies: Expert-level proficiency in at-least one of Java, C++, or Python (preferred). Scala knowledge a strong advantage Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies -- one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc. Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage. Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI) Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks. Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works. Linux environment and shell scripting

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us

Not the right fit? Let us know you're interested in a future opportunity by clickingin the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest

We have other current jobs related to this field that you can find below

  • BigData Engineer

    3 months ago

    Chennai, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems...

  • BigData Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doingThe BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and...

  • BigData - Tech Lead

    23 hours ago

    chennai, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...

  • BigData - Tech Lead

    2 days ago

    Chennai, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...

  • Bigdata / Hadoop Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Jobs for Humanity Full time

    Company DescriptionJobs for Humanity is dedicated to building an inclusive and just employment ecosystem.Therefore, we have dedicated this job posting to individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf of Hard of Hearing Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ, and...

  • Architect - Bigdata,Kafka

    20 hours ago

    Chennai, India Virtusa Full time

    Architect - Bigdata,Kafka - CREQ192590 DescriptionJob Description:Responsibilities:Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms.Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to Internal and External stakeholders.Identify data...

  • Architect - Bigdata,Kafka

    2 days ago

    chennai, India Virtusa Full time

    Architect - Bigdata,Kafka - CREQ192590 Description Job Description:Responsibilities:Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms.Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to Internal and External stakeholders.Identify...

  • Architect - Bigdata,Kafka

    2 days ago

    Chennai, India Virtusa Full time

    Architect - Bigdata,Kafka - CREQ192590 Description Job Description: Responsibilities: Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms. Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to Internal and External stakeholders....

  • Software Engineer I

    6 days ago

    Chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    Our CultureWe believe in creating a culture that inspires great thinking, because great thinking leads to real innovation. We believe in using the power of data and advanced analytics to help our customers make faster, better, informed decisions.We believe in the free expression of ideas, and we are committed to collaboration, partnership and delivering...

  • Software Engineer I

    2 weeks ago

    Chennai, Tamil Nadu, India RELX India (Pvt) Ltd Risk div Company Full time

    Our CultureWe believe in creating a culture that inspires great thinking, because great thinking leads to real innovation. We believe in using the power of data and advanced analytics to help our customers make faster, better, informed decisions.We believe in the free expression of ideas, and we are committed to collaboration, partnership and delivering...

  • Sr. Kubernetes Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Anicalls (Pty) Ltd Full time

    Candidate should have: Excellent interpersonal skills; strong desire to move projects forward and be proactive. Seeks opportunities to learn and improve Strong communication skills and Good knowledge of query optimization and performance tuning. Strong understanding of Bigdata technologies like HIVE, HBASE, HDFS, and any cloud storage like Blob storage or S3...

  • DevOps Engineer III

    2 weeks ago

    Chennai, Tamil Nadu, India Manpower Group Full time

    We are Hiring for Developer Engineer 3 role for Our MNC Product based Company in Chennai LocationExperience : 5 Years to 7.5 YearsLocation : Chennai Experience in Spark Experience in SQL Good programming and analytical skills. Strong into Spark Coding.Responsibilities : Responsible for delivering solutions based on data lineages Works handinhand with core...

  • Software Engineer I

    1 month ago

    Chennai, India RELX Full time

    Our Culture We believe in creating a culture that inspires great thinking, because great thinking leads to real innovation. We believe in using the power of data and advanced analytics to help our customers make faster, better, informed decisions. We believe in the free expression of ideas, and we are committed to collaboration, partnership and...

  • Software Engineer I

    4 weeks ago

    chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    Our Culture We believe in creating a culture that inspires great thinking, because great thinking leads to real innovation. We believe in using the power of data and advanced analytics to help our customers make faster, better, informed decisions. We believe in the free expression of ideas, and we are committed to collaboration, partnership and...

  • Software Engineer I

    4 weeks ago

    Chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    Our Culture We believe in creating a culture that inspires great thinking, because great thinking leads to real innovation. We believe in using the power of data and advanced analytics to help our customers make faster, better, informed decisions. We believe in the free expression of ideas, and we are committed to collaboration, partnership and...

  • Senior Data Engineer

    3 months ago

    Chennai, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...

  • GCP Developer

    2 months ago

    Chennai, India Nilasu consulting Full time

    JOB DESCRIPTION:Must Have: - Min 3 years' Experience with Building Pipelines using GCP-Big-Query - Min 2-3 Experience in working on Large Scale Data warehouses like Teradata - Experience building and optimizing data warehousing data pipelines (ELT and ETL), architectures and data sets. - Advanced working SQL knowledge and experience working with...

  • Senior Data Engineer

    6 days ago

    chennai, India Photon Full time

    What will you do ? What are we looking for? Strong Knowledge on Development/Building real time streaming applications using Spark or Flink with Kafka BigData and It’s Ecosystem knowledge is MUST (Hive, distributed processing etc) Strong Knowledge on Apache Spark (PySpark) is MUST Strong Knowledge on Apache AirFlow is MUST Good Knowledge...

  • Senior Data Engineer

    1 week ago

    Chennai, India Photon Full time

    What will you do ? What are we looking for? Strong Knowledge on Development/Building real time streaming applications using Spark or Flink with Kafka BigData and It’s Ecosystem knowledge is MUST (Hive, distributed processing etc) Strong Knowledge on Apache Spark (PySpark) is MUST Strong Knowledge on Apache AirFlow is MUST Good Knowledge on...

  • Data Architect

    4 weeks ago

    Chennai, India Peepal Consulting Full time

    A minimum of 10 years of experience indata architecture and analytics. Databricks:Proficiency in Databricks for data processing machine learningand analytics. Cloud Platforms: Strongexperience with any one or more cloud platforms such asAWS Azure GCP and the ability to integrate Databricks with them. Data Engineering: Strong experienceengineering concepts...