Vacantes de Desarrolladores de software en WEST YORKSHIRE (Reino Unido)
J00051598 Big Data Engineer (open)
Clasificación del trabajo:Profesionales científicos e intelectuales : Profesionales de tecnología de la información y las comunicaciones : Desarrolladores y analistas de software y multimedios : Desarrolladores de software. Professionals : Information and communications technology professionals : Software and applications developers and analysts : Software developers.
Descripción de la oferta de trabajo:
Equifax powers the financial future of individuals and organisations around the world. Using the combined strength of unique trusted data, technology and innovative analytics, Equifax has grown from a consumer credit company into a leading provider of insights and knowledge that helps its customers make informed decisions. The company organises, assimilates and analyses data on more than 800 million consumers and more than 91 million businesses worldwide, and its database includes employee data contributed from more than 5,000 employers. Headquartered in Atlanta, Ga., Equifax operates or has investments in 24 countries in North America, Central and South America, Europe and the Asia Pacific region. It is a member of Standard & Poor's (S&P) 500® Index, and its common stock is traded on the New York Stock Exchange (NYSE) under the symbol EFX. Equifax employs approximately 9,200 employees worldwide. Big Data Engineer Equifax is looking for an Experienced Big Data Engineer for its infrastructure team supporting our Big Data services in Leeds, UK, to support our EDEN platform. The ideal candidate will be interested in DevOps, embraces open source software and technology, likes to automate things and immerses themselves into the emerging industry trends and landscape for this space. Responsibilities are to develop and automate Big Data services; adopting new technology; and ensuring modern operations in order to deliver consumer driven Big Data solutions. EDEN is a UK based Hadoop cluster managed using Enterprise CDH5. It is multi-tenanted. Providing analytical support to a data scientist within the EU. It also has a batch functionality for services within Equifax and third party customers. EDEN specific responsibilities principally concern: * Working closely with infrastructure, network, business intelligence and application teams to ensure the cluster is highly available and performing within agreed service levels. * Ensuring that the cluster, and the data within it, is appropriately secured. Involving the creation and management of access controls. Monitoring of data transmission within and out of the cluster. Control of data lineage. * Adequate resource management between analytic and batch processing * Working closely with the Data and Analytics team to productionise products. Along with the development teams creation of batch processes. The Successful candidate will be team player to be part of a dynamic Big Data product team focused on modernization and automation. Responsibilities of the Big Data Engineer include: * Utilize engineering and programming skills focused on enabling a DevOps model * Install, configure and maintain physical and cloud servers running Linux * Deliver repeatable, reliable systems using Chef and domain specific tooling * Configuration and change management * Document operations and provide run books * Participate in and provide feedback on systems engineering and design * Streamline deployment of infrastructure into consumable services * Provide input on the future execution of the delivery and management of environments with a strong emphasis on automation, security, scalability and resiliency * Manage Hadoop clusters. Required Experience: * Bachelor’s degree or technical college diploma in a technical field or equivalent experience * Demonstrable cross-functional experience with Systems, Storage and Networking * Knowledge of Hadoop and the Hadoop ecosystem (YARN, HDFS,Hive, Impala, HBase, Sqoop, Oozie) * Knowledge of Spark, Cassandra, MongoDB * Proficiency in the Linux operating system * Proficiency in shell scripting * Proficiency in Java or Python and or SAS and R * Experience with configuration automation tools (Chef, Puppet, Ansible, Salt Stack, etc. (We use Chef)) * Familiarity with continuous integration and delivery * Familiarity with software development methods and techniques * Strong knowledge of cloud, IAAS and catalog based deployment models *
Servicio de empleo de origen:Department for Work and Pensions, Public Employment Services, United Kingdom.