Scaling Out your ProjectWise System Marty Nickel, Senior Systems Architect Project Delivery, Americas 1 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
2 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated Marty Nickel, Senior Systems Architect Project Delivery, Americas
Agenda Database Networks Load Balancing Caching Servers Archiving Automation of Tasks Backup/Archive 3 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Database Database Database 4 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Scale your database with your ProjectWise System!!! 5 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Indications of a Slow Database Slow folder navigation is the first sign Errors in dmskrnl logs: 2014-07-31 10:34:56,089 WARN [0x00000cb4] pwise.database - Statement execution took 8.0496 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 7122 and o_status = 1' 2014-07-31 10:34:56,266 WARN [0x000010d0] pwise.database - Statement execution took 8.0365 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 5338 and o_status = 1' 2014-07-31 10:35:32,270 WARN [0x00002ce0] pwise.database - Statement execution took 1.6132 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 521 and o_status = 1' 2014-07-31 10:35:32,399 WARN [0x00002934] pwise.database - Statement execution took 3.8467 seconds, exceeds performance threshold of 1.0000 seconds. 'select o_value from dms_rtv where o_rtvno =?' 2014-07-31 10:35:33,220 WARN [0x00002a70] pwise.database - Statement execution took 6.3001 seconds, exceeds performance threshold of 1.0000 seconds. 'select o_intval from dms_ucfg where o_userno =? and o_paramno =?' 6 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
How can I check to see if my dba is doing his job? 7 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
How do I prove my dba wrong? 8 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
9 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
10 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Key Points on Databases Dedicated Database Server if possible If the database is slow the users will be the first to complain A powerful database is needed Lots of CPU and RAM Fast Disks Follow Microsoft/Oracle Best Practices Updating Statistics and Rebuilding Indexes regularly 1x a week for small firms 3xs a week for medium firms Every day for large firms 11 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Network 12 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Latency. 13 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Bandwidth is like the lanes on a highway 14 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
15 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Key Points on Networks ProjectWise will be effected by high latency >300ms latency and ProjectWise will suffer greatly High Bandwidth + Low Latency = Better ProjectWise Performance QOS (Quality of Service) is important for the network traffic Determines the priority of the ProjectWise traffic The better the connection the better ProjectWise will run. Directly connecting to a hosted solution may be better due to internet connectivity 16 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Load Balancing 17 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Load Balancing your Integration Servers Storage on a SAN Load Balancer Indexing/Thumb nails/file Props Indexing/Thumb nails/file Props 18 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Automated File Processing Load Balancing 19 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Key Points on Clustering ~500 concurrently connected users per Integration Server If over 50% of memory utilization add another Integration Server Slower access will indicate this Makes upgrades much easier Keeps your ProjectWise system up all the time If your Indexing/Thumbnails/File Properties are not keeping up Remember every time a document gets checked out/in it gets marked for reprocessing Fastest known processing time is ~251,000 in a 24 hour period! 20 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Caching Servers 21 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Caching Server Servers Check In/Out & Update Files Inactive ProjectWise Connection Datasource Transactions Server Virginia USA Central Data Center London, England 22 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Storage Server at Project Site Servers Check In/Out & Update Files Inactive ProjectWise Connection Datasource Transactions Server Virginia USA Central Data Center Pune, India * ProjectWise Design Integration application servers, SQL/Oracle DB s, publishing servers, distribution servers and web servers can be on-premises, cloud provisioned by Bentley or a hybrid combination of the two deployment options. 23 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Key Points on Caching to take to your Users If there are more then 5-10 users in an office, add a caching server The first piece for increased performance Use fetchfiles.exe to prepopulate the cache If the connection is slow in a remote office, think about putting a storage area there 24 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Archiving 25 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
POW POW POWERSHELL!!! 26 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Key Points on Archiving Only active work should be in your datasource Lean and mean Use PowerShell to archive old data Can go to another datasource or disk Can modify the data when archived like no versions, read only, etc Able to run through a variety of ways Remove old projects that have been over for years 27 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Backup/Recovery 28 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Mirroring your Environment Primary Secondary 29 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
Automation of Tasks 30 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated 2016 Bentley Systems, Incorporated
Key Points on PowerShell Primarily meant for ProjectWise Administrators Most operations require an admin account Automate many administrative tasks Reports Lots of cmdlets 188 New- PWInputOutputPerformanceReport Attend the SIG and workshops SIG is 2 nd Thursday of every month Go to Bentley Communities for help! 31 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated
32 WWW.BENTLEY.COM 2016 Bentley Systems, Incorporated