Data Architect, Big Data Job Description
Data Architect, Big Data Duties & Responsibilities
To write an effective data architect, big data job description, begin by listing detailed duties, responsibilities and expectations. We have included data architect, big data job description templates that you can modify and use.
Sample responsibilities for this position include:
Data Architect, Big Data Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Architect, Big Data
List any licenses or certifications required by the position: AWS, TOGAF, RHCSA, DOD, CWAPT, CEPT, CPT, CEH, CREA, CISSP
Education for Data Architect, Big Data
Typically a job would require a certain level of education.
Employers hiring for the data architect, big data job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Technical, Math, Business, Mathematics, Software Engineering, Information Technology, Computer Engineering, Education
Skills for Data Architect, Big Data
Desired skills for data architect, big data include:
Desired experience for data architect, big data includes:
Data Architect, Big Data Examples
Data Architect, Big Data Job Description
- Full time senior development engineering role
- Provide leadership and guidance to project teams and other architects on all aspects of BI / Analytics data architecture (Data Curation needs and methods, normalized and dimensional data modeling, Analytics and Machine Learning Data needs, ETL, reporting)
- Provide guidance and consultation on specific delivery methodologies for BI/Analytics projects, such as technical requirements and model design review
- Work with the Data Modeler’s and Data Scientist (both internal and external) to set strategy and oversee design for significant data modeling and analytics work
- Participates in meetings to review the design of BI / Analytics projects
- Regularly interact with BI / Analytics leadership on project work status, priority setting and resource allocations
- Assist infrastructure leads and BI/ Analytics teams as needed with background and information on all technologies in use for projects such as new version upgrades, migration of hardware, production issues
- Provide leadership and guidance on setting up environments used by the BI / Analytics team so that they are optimized for a leveraged, multi-tenant operation
- 8+ years overall experience in application or solution development or consulting related to application or solution development
- Designing star schema data models
- BS, or equivalent, in Math, Computer Science or an applied quantitative field
- Hands-on experience in Big Data Components/Frameworks such as Hadoop, Spark, Storm, HBase, HDFS, Pig, Hive, Sqoop, Flume, Ozie, Avro
- Have hands-on experience with Cloudera Hadoop Administration
- Experience with the major big data solutions like Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark, Impala, Oozie, Mahout, Flume, ZooKeeper, Sqoop
- Firm understanding of major programming/scripting languages like Java, Python, R
- Experienced in design and build of enterprise Big Data solutions using modern data technologies (Hadoop, Spark, NoSQL)
Data Architect, Big Data Job Description
- Propose innovative technology solutions within the constraints of large-scale enterprises, and take the lead in implementing and evaluating these solutions
- Enable sales opportunities by working closely to the sale executives selling Big Data consulting work
- Innovation to support our clients on how to architect and deliver innovation based on the next generation of Big Data technologies and architectures
- Be a technical thought leader who helps shape both technical direction and process improvements across the Big Data landscape of a client
- Supervise architecture design, infrastructure design, technology build and deployment activities on multiple platforms
- Define and help enforce data governance and security policies in conjunction with delivery teams to setup new Hadoop users
- Assist the Technical Delivery Manager with assigned duties
- 20% Lead conversion planning and forecasting on a weekly, monthly, seasonal, and annual level
- 10% Draw reasonable and actionable conclusions from analytic summaries and recommend changes to existing policies and processes based on analytic conclusions and understanding of business requirements and drivers
- 10% Collaborate with peers to ensure consistency of information, methodologies and reports
- MSc Degree or equivalent in Software Engineering or similar technical discipline
- Over 10 years of experience in developing Data-oriented solutions
- Strong understanding of Big Data / Hadoop, Infrastructure, RDBMS, Data Warehousing, Analytics, Business Intelligence and Data Integration
- Experience working with Big and/or Fast data processing including environment and deployment models, ingest data pipelines, security and infrastructure
- Knowledge of in-memory data processing techniques
- Sound Java programming skills
Data Architect, Big Data Job Description
- Help improve development processes within and between teams
- Explore and gain mastery of multiple systems in order to ensure a cohesive product offering
- Explore and validate new technology platforms to solve business needs
- Code! Stay sharp, collaborate with your peers and deploy code
- Hadoop Ecosystem (map reduce, spark, hbase)
- Analytic Databases (Vertica)
- AWS Ecosystem
- Technical leadership role responsible for developing and maintaining data warehouse and Big Data roadmap ensuring Data Architecture aligns to business centric roadmap and analytics capabilities
- Establish data management and development standards for data warehouse, data integration and Big Data technologies
- Support ongoing data modeling and Integration efforts for all development and production environments including Big Data Design Patterns
- Knowledge and implementation of cloud based Big Data solutions
- Automated deployment scripting, Ansible, Puppet, Chef
- Experience with statistics, modeling and numerical analysis
- Knowledge of R language
- Must have experience in managing the full life-cycle of a Hadoop solution
- Advanced degree in Computer Science, Computer Engineering, IT, Operations Research, Industrial Engineering, Statistics, Mathematics, or similar technical field
Data Architect, Big Data Job Description
- Provide support for designing and building mission critical, high volume transactions and highly scalable systems across globally distributed data centers
- Leverage expertise in enterprise data modeling, data normalization, key or value pair modeling, use case modeling, business rule design, and storing metadata and data dictionaries within a formal modeling tool
- Unify the Global Insights tech stack into a strategically cohesive and operationally integrated end-to-end product suite
- Partner with key members of the technological organization at Blizzard to ensure the Global Insights team is in lock-step with greater technological initiatives at Blizzard
- Drive ongoing innovation and development to empower the analytics team with a best-in-business analytical data ecosystem
- Define solutions based on stakeholders needs, cost, and required integration with existing applications, systems, or platforms
- Research, identify, test, select, and drive adoption of technology products within the analytical data ecosystem to ensure ongoing best-in-class capabilities
- Contribution to creating, documenting and communicating the overall AVA technical architecture, strategy and roadmap
- Acting as the authority and an (technology) evangelist on current and best practice big data technologies within the Global Services and AVA organization
- Leading and consulting with stakeholders throughout the full lifecycle implementation of customer solutions built on the AVA platform, providing solution designs
- Experience on working in onshore/offshore model
- A professional, constructive and reliable approach to work
- Hands-on experience with the Hadoop stack
- Hands-on experience with open source software platforms and languages
- Strong Java or Scala development skills
- Extensive experience with cloud hosted applications
Data Architect, Big Data Job Description
- Manage all activities centered on obtaining data and loading into an Enterprise Data Lake
- Stay current with vendor/product roadmaps and make recommendations for adoption
- Create and tune SQL for views across federated sources including Hadoop, DB2 and Oracle
- Implement data virtualization architecture
- Collaborate with BI report developers on design for optimal performance
- Use business requirements to document clear and concise technical designs
- Maintain design and naming standards
- Contribute to project planning discussions, provide status updates for development progress and be a critical resource for issue resolution
- Designing and implementing modern, scalable data architectures for our clients leveraging Big Data and/or NoSQL technologies, covering on-premise and cloud-based deployment patterns
- Providing advisory services and thought leadership on modernising analytics environments leveraging Big Data technologies, including integration with existing data and analytics platforms and tools
- Experience in running, using and troubleshooting the Apache Big Data stack Hadoop FS, Hive, HBase, Kafka, Pig, Oozie, Yarn, Sqoop, Flume
- Understand the business need for big data – what kind of data, how much data, types of algorithms to be run, load on the system, budget - and recommend optimal solutions
- Build and implement the solution
- 15+ years experience in IT, with 5+ years in similar role
- 5+ years experience in hands-on large-scale software development/integration using Java/J2EE technologies
- 2+ years hands-on experience Hadoop ecosystem technologies (Hadoop, HDFS, Spark, MapReduce, Pig, Hive, Flume, Sqoop, Cloudera Impala, Zookeeper, Oozie, Hue, Kafka)