Staff Data Engineer Job Description
Staff Data Engineer Duties & Responsibilities
To write an effective staff data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included staff data engineer job description templates that you can modify and use.
Sample responsibilities for this position include:
Staff Data Engineer Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Staff Data Engineer
List any licenses or certifications required by the position: ITIL, AWS, CISA, CISSP, ASQ, NIST, CCIE
Education for Staff Data Engineer
Typically a job would require a certain level of education.
Employers hiring for the staff data engineer job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Science, Information Technology, Mathematics, Technical, Statistics, Technology, Business, Computer Engineering
Skills for Staff Data Engineer
Desired skills for staff data engineer include:
Desired experience for staff data engineer includes:
Staff Data Engineer Examples
Staff Data Engineer Job Description
- Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms
- Work in the Risk Data Analytics data engineering team
- Help with building big data deployment infrastructure
- Expert in building Data Sources that can scale to handle huge data volume
- Design, code, test, integrate, and maintain the Test Data Supply application suite
- Work in the Small Business Group (SBG) Data Engineering team
- Design the next generation distributed networking system from data
- Enthusiastic and principled about finding and applying the best practices related to dimension modelling and Big data analytics
- Work on ETL and high volume real time data pipeline
- Expert in fine tuning data sources/dashboards/reports for performance
- Significant (at least 2 year) experience in Java and with overall Hadoop eco system (HDFS, Map Reduce, Pig, Hive, etc…)
- Sound knowledge in ETL and Data Warehouse concepts
- Experience in relational database concepts and database architecture and design
- Expertise in Predictive Analytics
- Experience with cloud-based platforms
- Linux systems administration, managing execution of services, shell scripting, networking
Staff Data Engineer Job Description
- Actively participate and influence/drive BI (Tableau) infrastructure/architecture/design setup/changes
- Works closely with functional teams and individuals to design and create dashboards/reports to ensure accurate data and acceptable performance
- Configure, Implement and provide support around our Data Protection initiatives
- Create Data Protection Cloud Patterns with AWS
- Create Policies for Data Protection to be used across the company
- Enable and support Company wide Cloud Data Protection
- Design Data Protection solutions Using existing backup technologies for scalable applications
- Monitor Health of Data Protection Environment
- Troubleshoot issues pertaining to data protection success and performance
- Design and build scalable data models for large analytics datasets in AWS
- We're partnering with top internet retailers to create new products that bring personalized shopping to the next level
- We're collaborating with top industry partners (Facebook, Google, Yahoo, ) to build out the next generation of programmatic advertising infrastructure
- Expertise with full-stack development with a strong focus on designing and implementing simple, elegant solutions
- Ability to mentor others and thrive in an unstructured and dynamic environment
- Deep knowledge of software development process and expierence with tools in version control as git
- Create and support applications running in a distributed processing environment (Cloud Foundry)
Staff Data Engineer Job Description
- Transform data into actionable information by data analysis and Statistical/Analysis systems from requests
- Collaborate with cross functional team in analytical methods development to enable new critical process, parametric, yield monitoring, triggering capability, events prediction and system development for quick data-info-action transformation
- To improve root cause discovery methods/techniques to turn data into actionable information as quick as possible with acceptable level of accuracy of root cause identification
- Design and implement cloud foundry based solutions for various domains
- Participate in API-based integrations and back-end based loosely coupled architecture and pipeline
- Provide engineering support to other teams as needed
- Experience developing software against 3rd party APIs / RESTful web services and working with vendors to identify and correct issues and drive enhancements
- Participate in an Agile SDLC to deliver new cloud platform services and components
- Create and support applications running in a distributed processing environment
- Machine learning algorithm assessment, selection and enhancement for the problems being addressed
- 8+ years of large scale distributed software design and development experience
- Proficiency in Java/C++ and SQL/RDBMS
- Solid foundation of data structure and algorithm
- Experience in developing hosted applications and RESTful services
- Good communication abilities and capacity for teamwork
- Knowledge of multi-core CPU architectures is a big plus
Staff Data Engineer Job Description
- You will collaborate deeply with integration and information architects to define a variety of data ingestion pipelines and promote a data driven culture by providing access to real time data and improve business outcomes
- Provide vision for future technology for the Data Platform
- Leadership and mentoring for our engineering team as we continue to rapidly evolve the Data Platform
- You will quickly assess existing platforms and define a data platform strategy and build a roadmap for execution
- Key member of the Enterprise Architecture group recommending appropriate data platform choices for business domains
- You will evolve the architecture to support a wide spectrum of data needs ranging from analytical (descriptive and diagnostic), human-centric (predictive and prescriptive) to machine centric (decisions and actions)
- As a senior technical leader, you will mentor and guide a global team of data engineers
- Partner closely with teams to produce an application that flows seamlessly and works intuitively with our clients
- Work with architecture team on research & analyses of newer technologies for the next generation of ENT applications
- Be comfortable leading meetings and discussions with non-technical teams
- Experience working with Broadcom XGS network switching hardware and SDKs is a big plus
- A minimum of BS in CS/EE, MS degree is preferable
- Minimum 3 years of experience in research and development of RDBMS or NoSQL or OS related areas (file system, memory management, IO, or networking) or cloud related areas (cloud service architecture, virtualization, cloud storage architecture, or resource management) with Master in CS or a relevant field, or 5 years of experience with a Bachelor degree
- Knowledge in database storage subsystem, parallel query processing, query optimization, distributed transaction processing, workload management, or high availability features
- Experience with PostgreSQL kernel a plus
- Candidates should have at least 1 year of tools development experience for a telecom vendor, service provider or a 3rd party analytics tools company
Staff Data Engineer Job Description
- Integrate domain data knowledge into development of data and automation requirements
- Actively partner up with existing data science team members to identify key issues and craft your own solutions based off your knowledge and understanding of the tech stack and tool set
- Work in the CTO-Dev Development analytics platform team, provide end-to-end solution for engineering productivity analytics platform, while leveraging big data tools and technologies
- Work with Data Scientists to identify datasets needed for deep customer insights and for building operational propensity models
- Maintain and build ingestion pipelines to bring required source datasets into the data warehouse
- Define SLAs for data availability and correctness, respond to alerts when SLAs are not being met
- Create profile and scorecards on customer & contact data within various source system
- Build efficient duplication strategies for master data using Informatica MDM Hub
- Design, build and launch new data extraction, transformation and automated remediation in production
- Create Backup Governance and Compliance Tooling / Automation and Reporting
- A plus to be familiar with architectural components involved in the support of 3G/4G Mobile radio access networks/core, OAM, KPI
- 6+ years of professionalJava/C# software development experience
- Developing applications on Big Data / streaming platforms
- Modify & maintain code written in Java, Python, R
- Experience with different tools for massive data set analysis
- Experience with testing analytics/reporting on processed data