Contact info: (866) 371-0687,

Lead Big Data Engineer

Twitter Facebook
Wayne, NJ
Job Type
Direct Hire
Mar 07, 2019
Job ID

We have a permanent hire opportunity for a Big Data Engineer in Wayne, NJ 07470. Salary depends upon experience level.  Candidate must have experience with Talend Cloud platform.

The Lead Big Data Engineer plays a critical role in making sure the enterprise data and analytics strategy is envisioned, designed, developed and implemented across the organization to support the bank's strategic business goals.  This person will be responsible for the strategy around how we bring together complex data into clean and useful data structures making our valuable data more approachable using Talend.

Responsibilities include but are not limited to:
  • Oversee a team of Big Data Engineers including hiring, development and coaching, performance reviews and disciplinary action as needed.
  • Responsible for design, prototyping and delivery of Talend software solutions within the big data eco-system.
  • Improve data governance and quality increasing the reliability of our data.
  • Design, document, construct and deploy database architectures and applications that are scalable, secure, high performance and reliable.
  • Capture external datasets into the Cloudera Enterprise Data Hub, blend, conduct data profiling to develop datasets, and/or NoSQL databases.
  • Translate business needs into advanced analytical needs.
  • Automate data pipelines from various systems to create advanced analytics.
  • Capture data lineage to perform impact analysis.
  • Improve data quality of the enterprise data hub.
  • Research new opportunities for data acquisition and new uses for existing data.
  • Organize and run monthly lunch & learn sessions on best practices around Advanced Analytics using big data.
  • Maintain relationships with business users, technical groups, and Information Security group to determine appropriate data access security, data integrity, while improving performance.

Required Skills:
  • Must have experience working with HIVE tables.
  • Ability to communicate both verbally and written to employees in the business units utilizing non-technical language.
  • Ability to handle multiple priorities simultaneously and to delegate as needed.
  • Strong experience utilizing Microsoft PowerBI.
  • Knowledge of Trifacta Data Wrangling software.
  • Strong experience utilizing SQL and NoSQL databases.
  • Knowledge of integrating innovative technologies (e.g. Hadoop) with traditional RDBMS.
  • Strong experience utilizing Cloudera Enterprise deployments relational databases, Cloudera Manager databases, Hive Metastore, Hue database, Oozie database.
  • Knowledge of Microsoft Azure.
  • Knowledge of Impala with Kudo (interactive SQL).
  • Experience creating a data-driven culture and impactful data strategies.
  • Experience in Agile BI delivery within the financial industry.
  • Knowledge of integration concepts as they relate to sourcing data from disparate sources.
  • Required Experience:
  • B.S. in computer science or a related IT degree with a minimum of 7 years of information technology experience designing and managing Talend software data jobs within the Hadoop big data eco-system with a minimum of 3 years working with Hive tables. Must have Relational and non-relational database experience.
  • Prior supervisory experience preferred
  • Talend certification preferred.
Please note:
Locals/daily commuting distance preferred; no relo available. Work is onsite.
This position is not open to 3rd party c2c agencies and provides no visa sponsorship. All applicants must have permanent US work authorization and not require visa sponsorship now or in the future.