HomeMy WebLinkAbout226-19 RESOLUTION` CF FAYETTF i!
V
V m
•r
9RKAN`+►S
113 West Mountain Street
Fayetteville, AR 72701
(479)575-8323
Resolution: 226-19
File Number: 2019-0601
CH2M HILL ENGINEERS, INC:
A RESOLUTION TO APPROVE AN OUT -OF -SCOPE AGREEMENT WITH CH2M HILL
ENGINEERS, INC. IN AN AMOUNT NOT TO EXCEED $38,860.00 FOR SOFTWARE UPGRADES TO
THE SCADA SYSTEM USED BY WASTEWATER TREATMENT FACILITY OPERATIONS, LIFT
STATION OPERATIONS, AND WATER DISTRIBUTION SYSTEM OPERATIONS, AND TO
APPROVE A BUDGET ADJUSTMENT
BE IT RESOLVED BY THE CITY COUNCIL OF THE CITY OF FAYETTEVILLE,
ARKANSAS:
Section l: That the City Council of the City of Fayetteville, Arkansas hereby approves an out -of -scope
agreement with CH2M Hill Engineers, Inc., a copy of which is attached to this Resolution, in an amount
not to exceed $38,860.00 for software upgrades to the SCADA system used by the City's wastewater
treatment facility operations, lift station operations and water distribution system operations.
Section 2: That the City Council of the City of Fayetteville, Arkansas hereby approves a budget
adjustment, a copy of which is attached to this Resolution.
PASSED and APPROVED on 10/1/2019
Page 1 Printed on 10/2/19
File Number: 2019-0601
Resolution 226-19
Attest:
UEt -
AFL
Lisa Branson,
Deputy City CleY�2., -
NSAS ••
'/'�' COUNT �����``
1���M i i I IV%O
Page 2 Printed on 1012119
r24%�
City of Fayetteville, Arkansas 113 West Mountain Street
Fayetteville, AR 72701
(479) 575-8323
Text File
File Number: 2019-0601
Agenda Date: 10/1/2019 Version: 1 Status: Passed
In Control: City Council Meeting
Agenda Number: A. 9
CH2M HILL ENGINEERS, INC:
File Type: Resolution
A RESOLUTION TO APPROVE AN OUT -OF -SCOPE AGREEMENT WITH CH2M HILL
ENGINEERS, INC. IN AN AMOUNT NOT TO EXCEED $38,860.00 FOR SOFTWARE UPGRADES
TO THE SCADA SYSTEM USED BY WASTEWATER TREATMENT FACILITY OPERATIONS, LIFT
STATION OPERATIONS, AND WATER DISTRIBUTION SYSTEM OPERATIONS, AND TO
APPROVE A BUDGET ADJUSTMENT
BE IT RESOLVED BY THE CITY COUNCIL OF THE CITY OF FAYETTEVILLE, ARKANSAS:
Section 1: That the City Council of the City of Fayetteville, Arkansas hereby approves an out -of -scope
agreement with CH2M Hill Engineers, Inc., a copy of which is attached to this Resolution, in an amount not to
exceed $38,860.00 for software upgrades to the SCADA system used by the City's wastewater treatment
facility operations, lift station operations and water distribution system operations.
Section 2: That the City Council of the City of Fayetteville, Arkansas hereby approves a budget adjustment, a
copy of which is attached to this Resolution.
City of Fayetteville, Arkansas Paye 1 Printed on 101212019
Tim Nyander
Submitted By
City of Fayetteville Staff Review Form
2019-0601
Legistar File ID
10/1/2019
City Council Meeting Date - Agenda Item Only
N/A for Non -Agenda Item
9/12/2019 WASTEWATER TREATMENT (730)
Submitted Date Division / Department
Action Recommendation:
Staff recommends approval of an Out -of -Scope Letter Agreement with CH2M Hill Engineers, Inc. in the amount of
$38,860.00 for a SCADA software upgrade for wastewater treatment facility operations, lift station operations, and
water distribution system operations, and approval of a budget adjustment.
5400.730.5800-5314.00
Account Number
02032.1
Project Number
Budgeted Item? Yes
Budget Impact:
Water and Sewer
Fund
WWTP Building Improvements
Project Title
Current Budget
Funds Obligated
Current Balance
Does item have a cost? Yes Item Cost
Budget Adjustment Attached? Yes Budget Adjustment
Remaining Budget
$
773,585.00
$
772,947.76
$ 637.24
$
38, 860.00
$
38, 860.00
637.24
V20180321
Purchase Order Number: Previous Ordinance or Resolution #
Change Order Number:
Original Contract Number:
Comments:
Approval Date:
CITY OF
FAYETTEVILLE
ARKANSAS
MEETING OF OCTOBER 1, 2019
TO: Mayor and City Council
THRU: Don Marr, Chief of Staff
FROM: Tim Nyander, Utilities Director
DATE: September 12, 2019
CITY COUNCIL MEMO
SUBJECT: Out -of -Scope Letter Agreement with CH2M Hill Engineers, Inc. for a SCADA
Software Upgrade
RECOMMENDATION:
Staff recommends approval of an Out -of -Scope Letter Agreement with CH2M Hill Engineers,
Inc. in the amount of $38,860.00 for a SCADA software upgrade for wastewater treatment
facility operations, lift station operations, and water distribution system operations, and approval
of a budget adjustment.
BACKGROUND:
Over the past year the City Utilities and the City IT staff have been working with CH2M local
staff and Jacobs network and SCADA teams to upgrade the entire SCADA system to increase
security, stability, functionality, and provide a path for future enhancements. Over 40 new
enterprise class network switch endpoints have been deployed over the last 6 months to begin
the upgrade project, but are now to the point where replacement of major SCADA components
are needed. City IT staff, CH2M, and Jacobs have had many discussions on how to proceed
with the upgrade and are at the point of needing to develop a detailed implementation plan.
DISCUSSION:
SCADA systems are complex and require a holistic review and design to ensure the new
system provides the required functionality with the least complexity and expense as possible.
CH2M has provided the City with a statement of work to develop a detailed network plan,
software implementation plan, and server plan. This plan will detail the exact design, required
equipment, software, and provide a cost estimate to implement. CH2M Hill Engineers will share
50% of the cost of this first phase of the project.
BUDGET/STAFF IMPACT:
Funds will be moved from the Sanitary Sewer Rehabilitation account to the WWTP Building
Improvements account to cover the costs of the SCADA software upgrade.
Attachments:
Out -of -Scope Letter Agreement
Budget Adjustment
Mailing Address:
113 W. Mountain Street www.fayetteville-ar.gov
Fayetteville, AR 72701
il BS
September 12, 2019
Mr. Tim Nyander
City of Fayetteville
113 West Mountain Street
Fayetteville, AR 72701
Subject: Out -of -Scope Letter Agreement
SCADA Software Upgrade
Dear Mr. Nyander:
9191 S. Jamaica Street
Englewood, CO 80211
ww.jacobs.com
CH2M Hill Engineers, Inc. (CH2M HILL) will provide the following out -of -scope services/materials:
What is being provided: Refer to Exhibit A for the services to be provided in support of
the SCADA Software Upgrade.
When it is being provided: CH2M HILL will commence work within 10 working days of
receiving a written notice to proceed with the project. The
anticipated project duration is 2-3 months.
Price of services: The fee is calculated based on the hourly rates, and the
estimated Level of Effort (LOE) for this Scope of Services.
Compensation will be on a not -to -exceed basis, and the project
compensation will not exceed a value of $38,860 without
written authorization from the City of Fayetteville.
Payment terms: Invoices shall be paid in accordance with Section 4.2 of the
Agreement dated December 5, 2009.
All other terms and conditions of the Agreement dated December 5, 2009 including all
Amendments 1 through 10, between CH2M HILL and the City of Fayetteville remains in full
force and effect.
If these terms are agreeable to you, please sign both copies of this letter. We will return one
fully executed original for your files.
CH2M HILL appreciates the opportunity to provide these additional services to the City of
Fayetteville.
Sincerely,
Greg Weeks
Both parties indicate their approval of the above described services by their signature below.
Authorized CH2M HILL:
Name: Steve Carpenter
Title: Manager of Projects_
Date: 9/12/2019
CH2M HILL ENGINEERS INC CONFIDENTIAL
60
EXHIBIT A
City of Fayetteville, Arkansas SCADA Software Upgrade
Article A. Purpose and Scope of Services
The purpose of this project is for CITY to authorize and direct CH2M HILL to develop and
execute a SCADA software upgrade project for the CITY SCADA system. The existing
SCADA software is obsolete and has significant vulnerabilities. This project intends to
upgrade the existing SCADA software (and overall SCADA system) to a FactoryTalk View
system on the Nutanix HCI platform. Overall, this project will provide the following
services:
• The procurement and installation of
FactoryTalk View HMI software and
related SCADA software.
• The development of functional
requirements for CITY SCADA system.
• The modifications or reconfiguration of
existing network infrastructure to
accommodate the software upgrade.
The procurement and installation of Nutanix
HCI and related computing hardware (i.e.
clients, workstations, network switches,
protocol gateways, etc.)
The development of new SCADA applications
per functional requirements.
The deployment and configuration of the new
SCADA software, hardware, and applications.
The following definitions will be used throughout this document.
Term
Description
CH2M HILL
Local and remote CH2M HILL staff to include engineering staff.
O&M Staff
Local CH2M HILL staff who operate and maintain CITY facilities.
CITY or
City of Fayetteville's management and, or technical staff.
CITY IT
HMI
Human Machine Interface: graphical software used to interface a SCADA
system.
HCI
Hyper -Converged Infrastructure: a hardware storage and virtualization
platform
Scope of Services
Project Understanding
CH2M HILL operates and maintains the following facilities and their corresponding control
systems for CITY.
• Paul R. Noland Wastewater Treatment
Plant
CH2M HILL ENGINEERS INC CONFIDENTIAL
• Biosolids Management System (BMS)
• City Water & Sewer Office (W&S Office)
(Noland WWTP)
• West Side Wastewater Treatment Plant
(West Side WWTP)
• Wastewater Lift Stations, Water Pump
Stations, and Water Tanks
An evaluation of the control systems for these facilities was performed at the request of
CH2M HILL O&M management. The evaluation included an assessment of the overall
SCADA system, the interconnecting control and communication networks, the
Programmable Logic Controllers (PLCs), and the Remote Terminal Units (RTUs).
Instrumentation and process control were not evaluated.
The existing SCADA system utilizes National Instruments Lookout HMI software package
for plant process visualization and control. This HMI software package is no longer
commercially available nor supported. Furthermore, it currently runs on computing
hardware and Microsoft operating systems that are also obsolete and no longer
commercially available nor supported. Therefore, the immediate SCADA system need is to
replace the existing Lookout system (i.e. software and correlating hardware) as a catastrophic
failure has the potential to adversely impact operations for an extended period of time.
The scope of this project will be to implement a new FactoryTalk View and Nutanix HCI
system that will fulfill immediate and future SCADA system needs. It will also be to
determine and implement any infrastructure changes required to support the new SCADA
software and address cyber security concerns. The resultant, new core infrastructure will be
designed to be utilized concurrently with ongoing integration projects throughout the
operating facilities and remote sites.
The work specified in this memorandum is to be executed with minimal interruption to
existing operating facilities and remote sites. The new SCADA software will run in parallel
to the existing Lookout system during the testing and training phases. At the conclusion of
the training phase, the existing Lookout system will be removed.
A preliminary review of the PLCs and RTUs was performed, but a comprehensive
evaluation is pending. It is anticipated that these devices, and any desired process
enhancements, will be upgraded at a later date and under an alternate project. The focus of
this project is to replace the existing Lookout system with a new, supportable system having
the capabilities to leverage technological advancements. This project will not address PLC or
RTU items identified at the operating facilities and remote sites; however, through careful
planning in this phase, new installations of PLCs and RTUs will only require minimal
adjustment.
Additionally, a SCADA Master Plan was created to capture and order priority projects for a
holistic approach to the modernization of the entire SCADA system and related subsystems.
This project represents one of the high-priority projects.
This task order includes only Tasks 1, 2, and 3 at this time, with tasks 4, 5, and 6 to be
developed following completion of Task 2.
CH2M HILL ENGINEERS INC CONFIDENTIAL
Project Tasks
Task 1 — Overall Project and Quality Management
The objective of this task is to charter the project by defining the design team, management
team, individual roles, personnel contact information, and project controls.
Task 2 — SCADA System Key Objectives
The objective of this task will be to define CITY functional requirements of the new SCADA
software (and overall SCADA system) and to develop the future state. This task will contain
several activities.
1. Conduct a 4 -hour, SCADA System Key Objectives meeting with CITY to discuss the
immediate and future functional requirements of the new SCADA software.
a. Prior to the meeting, JACOBS will provide CITY with a SCADA System Key
Objectives list for their consideration. The objectives should be reviewed,
and responses to the objectives should be returned prior to the meeting.
The responses will be tabulated and utilized during the meeting to drive
conversation and define functional requirements for the new SCADA
software (and overall SCADA system).
b. The meeting will include defining hardware installation sites for the new
SCADA applications (see Task 4). Three (3) hardware installations will be
designed for three (3) SCADA applications. The installations will be
strategically located so that the new SCADA application will service the
facility where it is physically located as well as any surrounding, or logically,
connected sites. Each facility (i.e. Noland WWTP, West Side WWTP, BMS,
W&S Office, Wastewater Lift Stations, Water Pump Stations, and Water
Tanks) will be supported by one of the three installations (/SCADA
applications). Currently, JACOBS has targeted Noland WWTP, West Side
WWTP, and W&S Office as the installation sites; however, installation sites
are flexible.
c. The meeting will include appropriate personnel identified by CITY to
participate, and a minimum of two (2) JACOBS engineers will attend the
meeting.
d. CITY will host the meeting in a conference room at their main building.
2. CH2M HILL will gather all files (Lookout HMI application, PLC code, etc.) needed for
development.
3. CH2M HILL will develop future state of the SCADA system per functional
requirements.
4. CH2M HILL will publish a Technical Memorandum reflecting results from the
onsite meeting and detailing future state of the SCADA system.
Deliverables
1. Technical Memorandum which will contain the following information.
a. Meeting Minutes
b. Functional Requirements
c. Hardware Install Locations
d. Future State Details
CH21VI HILL ENGINEERS INC CONFIDENTIAL
e. Network and system diagrams (rack diagrams, logical and physical network
diagrams)
f. Procurement strategy
Task Assumptions
1. CITY personnel will have responded to the SCADA System Key Objectives list, 5
working days prior to the onsite meeting.
2. Three to four data concentrators will be included in the design.
Task 3 — SCADA Software and Hardware Procurement Support
The objective of this task will be to support the procurement of the new SCADA software,
licensing agreement(s), and hardware to begin developing the new SCADA applications.
Based on current project understanding, the hardware components will include but are not
limited to:
Hyperconverged Virtual Server Host
DMZ Server Host
Core Network Switches
SCADA Firewalls
GPS NTP Servers
SMS Modems
NAS
Misc patch cables and periphery equipment
Data Concentrator PLCs
Based on current project understanding, the software components will include but are not
limited to:
SCADA HMI Software
SCADA Historian Software
SCADA Programming Software
Microsoft Software
Backup Software
Remote Access Software
Network Monitoring Software
Anti -Virus Software
Task Assumptions
1. Procurement strategy will be finalized prior to initiation of this task.
2. Hardware and software costs are not included in this scope.
Task 4 (Future) — SCADA Application Development
Subtask 4.1 - SCADA Software and Hardware Configuration
The objective of this subtask will be to prepare the SCADA software and hardware for use.
In this task, CH2M HILL will, in a lab environment, assemble the Nutanix HCI hardware,
program switches and firewalls, GPS NTP servers, SMS modems, build all virtual servers
CH2M HILL ENGINEERS INC CONFIDENTIAL
including SCADA active directory, backup server, remote desktop servers, and all services
required for the FactoryTalk View software and historians. All software will be installed.
CH2M HILL will configure and test the system for base functionality with a testbench PLC
running the PLC code acquired in Task 2.
Subtask 4.2 - SCADA Standards for Process Graphics and HMI Screens
The objective of this subtask will be to develop SCADA Standards for Process Graphics and
HMI screens. Operational control and process layout (i.e. functional specifications) will be
based on the existing Lookout HMI application. Advantages of the new SCADA software
will be utilized where possible, but limitations will exist due to PLC and RTU programming
and available data. The intent is to mimic the existing Lookout HMI application, but also
prepare for future enhancements. CH2M HILL will also publish a Technical Memorandum
reflecting the functional specifications for CITY approval.
Subtask 4.3 - SCADA Site -Specific Application Development
The objective of this task will be to develop and lab -test the Site -Specific SCADA
applications, which conform to functional requirements of CITY and the SCADA Standards
defined, and approved, in Subtask 4.2. The Site -Specific SCADA applications will be
implemented to replace the existing Lookout system with similar screens and functionality
while being prepared for future enhancements. CH2M HILL will develop the Process
Operator -Use Training Manual upon completion of application development.
Task 5 (Future) — SCADA Application Installation
The objective of this task will be to install the Site -Specific SCADA hardware with all pre-
configured software and virtual servers at their respective sites, including the DMZ. This
task includes complete SCADA network segregation from the CITY business network.
CH2M HILL will perform the installations and startups for each site. The installations and
startups will be performed sequentially, unless other provisions are arranged, and those
provisions are approved with CITY. Each application will be installed in parallel to the
existing Lookout system. A Performance Acceptance Test (PAT) will be performed after each
installation by validating the new Site -Specific SCADA application against the existing
Lookout system. Site -Training will be performed concurrently with PAT.
Task 6 (Future) — Post -Project Activities and Support
The objective of this task will be to identify and discuss additional or desired support of the
SCADA system after all installations are complete.
Project Assumptions
1. The scope of the SCADA Software Upgrade is limited to Noland WWTP, West Side
WWTP, BMS, W&S Office, Wastewater Lift Stations, Water Pump Stations, and Water
Tanks.
2. Task 1 SCADA System Key Objectives meeting will be held onsite at CITY offices. Task 1
design work will be performed remotely.
3. Unless specified, all deliverables will be provided in electronic format.
CH2M HILL ENGINEERS INC CONFIDENTIAL 7
4. Key managers and staff from both CITY and FAY shall provide written review
comments for deliverables via email within 10 working days. Otherwise, deliverables
shall be considered acceptable as submitted. Comments will be addressed, and a final
document issued.
5. Lack of complete and accurate documentation including as -built existing panel wiring
diagrams, documented PLC code, network diagrams, and complete I/O list will have
the potential to affect the project accuracy.
6. CITY and FAY will be available to assist during the site visits or workshops to include
reserving meeting space and providing access to equipment and panels.
7. Level of effort for Tasks 4, 5, and 6 will be developed after Task 2.
CH21V HILL ENGINEERS INC CONFIDENTIAL
Total 499 $ 77,719"
•' CH21M Hill Engineers will share in the cost of this project where the City of Fayetteville will be responsible for 50% or $38,860.00.
City of Fayetteville, Arkansas - Budget Adjustment Form (Legistar)
Budget Year Division Adjustment Number
/Org2 WASTEWATER TREATMENT (730)
2019
Requestor: Cheryl Partain
BUDGET ADJUSTMENT DESCRIPTION / JUSTIFICATION:
A Budget Adjustment is needed in the WWTP Building Improvements project for the a SCADA software upgrade for
waterwater treatment facility operations and water distribution system operations. Budgeted funds from the Sanitary
Sewer Rehabilitation project will be transferred to this project to cover the cost of this item. The budgeted funds being
transferred are for sewer rehabilitation/replacement and maintenance.
COUNCIL DATE: 10/1/2019
LEGISTAR FILE ID#: 2019-0601
Lirk9utcheww
9/13/2019 10:45 AM
Budget Director
TYPE:
JOURNAL #:
Date
D - (City Council)
H:\Budget Adjustments\2019_Budget\City Council\10-01-2019\2019-0601 BA CH@M Hill Engineers Inc 1 of 1
GLDATE:
RESOLUTION/ORDINANCE
I CHKD/POSTED:
TOTAL
- -
v.20190516
Increase / (Decrease)
Proiect.Sub#
Account Number
Expense Revenue
Project Sub.Detl AT
Account Name
5400.730.5800-5314.00
38,860 -
02032 1 EX
Professional Services
5400.720.5700-5815.00
(38,860) -
02017 1 EX
Sewer Improvements
H:\Budget Adjustments\2019_Budget\City Council\10-01-2019\2019-0601 BA CH@M Hill Engineers Inc 1 of 1