Technical Lead - Big Data Senior Level

Job Description

About TO THE NEW:

TO THE NEW (TTN) is a technology services company that designs, builds, & runs digital products and platforms for Fortune 500 companies, enterprises, SaaS, and consumer tech companies. We are recognized by global analyst firms like Gartner, Everest, ISG, and Zinnov for our capabilities in Digital Engineering, Cloud, and Data & Analytics. We have deep expertise in Experience design, Open source technologies across Web, Mobility, CMS, diverse Cloud infrastructures, DevOps, Big data & analytics, Quality, and test automation; combined with proven experience in Agile methodologies.

Founded in 2008, TTN is one of the fastest-growing companies with a growth rate of over 60% since 2017. Our passionate team of 2000+ “Newers” is spread across our delivery centers in Delhi, Dubai, NYC, and Sydney. TO THE NEW is a consistent winner of the prestigious ‘Great Place to Work’ award since 2015 and ranked #47 in the ‘Top 100 companies in India to Work’ for in 2019. Recently TTN was also recognized as one of the ‘Top 25 India’s best IT & IT-BPM workplaces’.

We take pride in our culture driven by passion for making an impact through technology and are backed by our emphasis on learning and development. Get a sneak peek of our work culture here.

Responsibilities:

• Define client needs and oversee project milestones to ensure expectations, timelines, and budgets are met

• Define data platform architecture and design, have hands on capability to review code and make required changes

• Leverage extensive knowledge of distributed systems, process flows and procedures to aid analyses and recommendations for solution offerings

• Responsible for the overall quality of project deliverables and the successful implementation of defined solution for the customer

• Build long-term, superior client relationships and proactively manage client expectations, and ensure that change control is used when scope boundaries are exceeded

• Communicate a compelling and inspired vision to all customer levels, from CTOs/CIOs, to engineering managers and programmers.

• Maintain a strong network and promote the organization at various meetings, forums, panels, publications, and conferences to establish thought leadership in the industry

• Responsible for POCs on any tech stacks introduced, or possible version upgrades.

Job Specification

Must Have:

• At least 8+ years of experience in design and development using various database technologies with recent 4+ years associated Hadoop technology stack and programming languages

• Hands­-on and technical lead experience in 2 or more areas:

  • Hadoop, HDFS, MR

  • High Availability architecture and DR setup

  • Spark Streaming, Spark SQL, Spark ML

  • Kafka/Flume.

  • Apache NiFi

  • Worked with Hortonworks Data Platform as Architect CDH (Cloudera Distribution for Hadoop) as developer/administrator

  • Hive / Pig / Sqoop

  • NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB

  • Visualisation & Reporting frameworks like D3.js, Zeppelin, Grafana, Kibana Tableau, Pentaho

  • Scrapy for crawling websites

  • Good to have knowledge of Elastic Search

  • Good to have understanding on Google Analytics data streaming.

  • Data security (Kerberos/OpenLDAP/Knox/Ranger)

• Should have a very good overview of the current landscape and ability to visualise technology and industry trends

• Ability to successfully lead a team of big data engineers and big data developers through all phases of the development life cycle, including requirements definition, architecture, design, development, implementation, and testing

• Working knowledge of Big Data Integration with Third party / in house built Metadata Management, Data Quality, Master Data Management Solutions, Structured/Unstructured data

• Have been active in the community in terms of articles / blogs / speaking engagements at conferences

This Job is expired. The Company is no longer accepting applications for this position.