forked from lsst/qserv
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathRELEASE-NOTES.txt
731 lines (603 loc) · 26.9 KB
/
RELEASE-NOTES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
R E L E A S E 2016_08
=======================
Release highlights:
* DM-5913: Long running shared-scan queries now moved automatically to snail-scan
Code improvements:
* DM-6813: Track statistics about queries and tasks running per chunk
* DM-7208: Minor fixes for issues flagged by Eclipse Neon C++ code analyzer
* DM-6972: Documentation updated for new location of newinstall.sh
* DM-7030: XRootD updated from upstream (now current to upstream SHA 03430C9)
* DM-6160: Enable configuration of "largeResultPoolSize" parameter via czar config file
Docker:
* DM-6444: Docker container builds now run with -j$(nproc) for faster builds
* DM-7214: Fix for broken Travis CI builds (remove obsolete docker-spy)
* DM-5967: Docker cluster deploy now uses Docker Swarm instead of shmux
* DM-6922: Container build updated for new location of newinstall.sh
R E L E A S E 2016_06
=======================
Release highlights:
* Scan scheduler enhancement to reduce query start delays
* Memory lock limit raised on docker containers for better shared scan performance
* Asynchronous memory locking for better shared scan performance
* End-to-end script to launch multi-node integrations tests on OpenStack
Code improvements:
* DM-5906: Remove the qmeta::QueryId and use the typedef of QueryId instead
* DM-5907: Replace the heap in ScanScheduler with a list
* DM-6518: Fix scheduler delays caused by mlock call in memman
Docker:
* DM-6062: Launch integration tests using Docker+Openstack
* DM-6177: Increase memory locked amount in container
R E L E A S E 2016_05
=======================
Release highlights:
* Robust handling of queries with multi-gigabyte result sets.
Code improvements:
* DM-6324: Modernize python code in Qserv admin tools
Docker:
* DM-6130: Fix git script failure when both -R and QSERV_DIR are provided
Bug Fixes:
* DM-5908: Worker thread pool fixes so workers don't lock up when sending large results
* DM-5909: Czar thread pool fixes so czar doesn't lock up when receiving large results
* DM-5910: Czar throttling so czar doesn't lock up when receiving multiple large results simultaneously
* DM-6149: Reduce memory utilization in mysql proxy when handling large results
* DM-6292: Allow spaces in LSST_LIBRARY_PATH for OSX
* DM-1355: Clean up installation files: cfg/ and proxy/ moved under share/ and lib/ for consistency
R E L E A S E 2016_04
=======================
Release highlights:
* Bug fixes to re-enable scripted large-scale tests
* Bug fixes for new shared scans
Code improvements:
* DM-5209: Improve worker configuration files
* DM-5788: Xcode 7.3 compiler issue
* DM-5394: Investigate boost compiler warnings and update boost to v1.60
Documentation:
* DM-5754: Improvements to install documentation
Docker:
* DM-4438: Replace sed with awk for docker template expansion
* DM-5187: Set Qserv master in env variable for Docker containers
Bug Fixes:
* DM-5514: Shared scan bug fixes
* DM-5307: Query distribution threading fixes
R E L E A S E 2016_03
=======================
Release highlights:
* Unique query IDs in logging
* Improved memory-managed shared scans
* Multi-node integration tests running in Travis CI
* Docker scripts now support multiple clusters
* Service timeout bug fixed
New features:
* DM-5314: Implement unique query-id generation
* DM-4755: Add unique query-ids to log messages
* DM-5218: Run Qserv multi-node integration tests in Travis CI
Code improvements:
* DM-2320: Remove deprecated merging code
* DM-991: Add query involving a blob to the integration tests
* DM-5313: Refine shared scan memory manager implementation
Docker:
* DM-5402: Make cluster deployment scripts more generic
* DM-5319: Fix container used by mariadb CI
Bug Fixes:
* DM-5336: Fix minor issues in docker procedure
* DM-5594: Fix qserv service timeout issue
R E L E A S E 2016_02
=======================
Release highlights:
* Removed all remaining dependencies on mysql/mysqlclient
* Memory-managed shared scans
* User-friendly thread IDs in logging
New features:
* DM-4943: Switch to MemManReal memory manager in worker scheduler
* DM-4756: Support human-friendly thread ID in logging messages
* DM-4697: Implement worker scheduler for shared scans
* DM-4648: Support connection to qserv from sqlalchemy client
Code improvements:
* DM-5204: Removed all remaining LOGF macro usage from qserv
* DM-5202: Removed deprecated LOGF macros entirely from log package
* DM-4938: Update to scisql 0.3.5
* DM-4786: Update mysqlproxy to 0.8.5
* DM-4440: Remove unused code in worker and configuration templates
* DM-3949: Remove mysqldb dependency in wmgr
* DM-2900: Add integration tests to excercise non-box spatial constraints
Docker:
* DM-3985: Support multinode integration test on single host
Bug fixes:
* DM-5125: Fix qserv failure when mixing mariadb/mariadbclient directories
* DM-5122: Explicitly enable LOAD DATA LOCAL for mariadb
* DM-5026: Remove stale mysqlclient dependeny from eups sqlalchemy package
R E L E A S E 2016_01
=======================
Release highlights:
* Query cancellation works
* Switched to MariaDB
* czar now runs inside mysql proxy
* Switched to stream-based logging
* Switched to using external sphgeom
* Improved packaging of shared libraries in scons
* Designed interfaces for memory management for shared scans
New features:
* DM-2522: Implement distributed database deletion
* DM-224: Switch to MariaDB
* DM-4807: Add Shared Scan Table Information to CSS
* DM-4677: Design Interfaces for Memory Management for Shared Scans
Code improvements:
* DM-4348: Replace XML-RPC with in-process communication
* DM-3447: Improve packaging of shared libraries in scons
* DM-4616: Migrate Qserv code to stream-based logging
* DM-2178: Migrate Qserv to external sphgeom
* DM-4383: Avoid restarting czar when empty chunk list changes
* DM-3037: remove lsst/log wrapper from Qserv
* DM-2699: Final cleanup of Query cancellation code
* DM-2421: Improve support for Python modules in Scons
* DM-4753: Cleanup location of anonymous namespaces
* DM-3888: Add missing space after if in Qserv code to conform to standard
* DM-2452: Replace toString() function
* DM-2060: Rename TaskMsgFactory2
Docker:
* DM-4295: Run and document multinode integration tests on Openstack+Docker
* DM-4523: Fix startup.py inside Docker container
Bug fixes:
* DM-4529: Compilation errors from CLang (Apple LLVM 7.0) in XCode 7 on MacOSX
* DM-4470: squelch some minor gcc 5.2 warns
* DM-4704: Qserv integration tests fail on CentOS7 with gcc 4.8.5
* DM-4705: qdisp/testQDisp fails with mariadb
* DM-4928: Fix intermittent testQdisp failure
* DM-4648: Support sqlalchemy use with qserv
Documentation:
* DM-4105: Update user documentation
R E L E A S E 2015_11
=======================
Release highlights:
* Progress with Implementing Database & Table Mgmt
* Improvements to query cancellation code
Code improvements:
* DM-4138: Re-implement packed keys in CSS
* DM-2622: Modify czar to support table deletion
* DM-2624: Implement DROP table in watcher
* DM-2625: Create service for managing watcher
* DM-3945: Simplify task queuing / Runner code
* DM-3563: Add unit tests to exercise new scheduler
* DM-3564: Integrate Qserv code with cancellation-friendly xrdssi
* DM-4395: Update cmsd configuration for multi-node tests
Bug fixes:
* DM-4206: wmgr should delete database from inventory when dropping it
* DM-4398: Fix regexp for gcc48
R E L E A S E 2015_10
=======================
Release highlights:
* Switched away from zookeeper to MySQL for CSS
* Cancellation-related code cleaned up
Code improvements:
* DM-4003: Replace zookeeper CSS with mysql
* DM-3946: Cleanup cancellation-related worker code
* DM-3952: Cleanup lua miniParser
* DM-4092: Update qserv for lastest xrootd
* DM-2873: Handle "where objectId between"
* DM-2334: Simplify interactions with XrdOss
* DM-3755: Revisit shared scans design
* DM-3192: Re-implement watcher based on new CSS implementation
* DM-3574: Replace qservAdmin.py use with CssAccess
* DM-4145: Reduce scons output in qserv
Documentation improvements:
* DM-3910: Run and document multi-node test with docker
R E L E A S E 2015_09
=======================
Release highlights:
* Simplified executor
* Added support for clang / Mac OS X
* Switched to SQLAlchemy based db module
* Reduced/isolated dependency on mysql
* Added support for IN queries
* Integrated Qserv with pipelines and SUI
* Ported to C++11 continued (nullptrs)
Code improvements:
* DM-3562: Refactor executor code
* DM-2733: Generalize / Simplify Facade
* DM-3805: uint type is non-standard
* DM-3663: Add support for clang and OS X to qserv scons
* DM-3584: Port Qserv to OS X/Clang
* DM-3803: Fix Qserv compiler warnings with clang
* DM-3915: Unused local typedef warning in Qserv
* DM-3779: clean up gcc and eclipse code analyzer warns
* DM-3707: qserv scons - do not copy files to variant_dir
New features:
* DM-3199: Standardize Qserv install procedure: step 1 build docker
container for master/worker instance and development version
Bug fixes:
* DM-3656: Data loader doesn't work for match tables
* DM-2887: Fix broken IN - it now takes first element only
* DM-3772: Fix compiler detection for non-default gcc/g++ compiler
* DM-3779: Fix compiler detection in Qserv for non-gcc compiler
* DM-3686: Fix PATH and compiler version detection in qserv scons
Documentation improvements:
* DM-3922: Update multi-node setup documentation
R E L E A S E 2015_08
=======================
Release highlights:
* Further improvements to reliability
* Implemented MySQL-based KVInterface for CSS
* Improved compatibility with webserv
Code improvements:
* DM-3450: Fix cluster install procedure and improve docker support
* DM-3456: Fix problems with talking from webserv to qserv
* DM-2558: Migrate qserv code to reworked db/dbPool
* DM-2956: Migrate Qserv code to nullptr
* DM-3253: Unify KVInterface python and c++ interfaces
* DM-3555: Ignore "SELECT @@tx_isolation" queries
* DM-3947: Remove dependency on mysqldb in wmgr
* DM-3358: Add mysql-based test to multi-node integration test
* DM-3360: Minor cleanup related to max_hostname
* DM-1662: Make qserv dependencies build on OS X with clang
* DM-3450: Tweaks to configurations discovered during S15 tests
New features:
* DM-3163: CSS/QMeta interaction in czar
* DM-3161: Implement MySQL-based KVInterface
Bug fixes:
* DM-3936: Fix "Executive error executing job" on the cluster
* DM-3943: QMeta thread safety
* DM-3522: Releasing un-acquired resources bug
* DM-2930: Fix problem with Qserv related to restarting mysql
* DM-3618: Fix bug related to restarting xrootd in wmgr
R E L E A S E 2015_07
=======================
Release highlights:
* Reliability in multi-node environment greatly improved:
critical bug fixes related to problems at scale.
* Added support for ORDER BY
* Completed query metadata
* Miscelaneous code cleanup
Code improvements:
* DM-3104: Add "ORDER BY" clause to lua SQL query on result table
* DM-1709: Implement result sorting for integration tests
* DM-2885: Improve confusing error message
* DM-3223: Improve czar-worker communication debugging
* DM-3090: Implement test suite for new class SqlTransaction
* DM-3110: qserv code cleanup
* DM-3235: qserv missing direct dependencies
* DM-3091: Remove unused function populateState()
* DM-3238: Add qserv-restart.sh
New features:
* DM-2805: Complete Query Metadata Implementation
* DM-2966: Design CSS that supports updates
Bug fixes:
* DM-3261: Fix problems in xrootd discovered in multi-node qserv tests
* DM-3237: Fix problems with no-result queries on multi-node setup
Documentation improvements:
* DM-2420: Document API for worker management service
* DM-3224: Document setting up multi-node Qserv and running integration test
R E L E A S E 2015_06
=======================
Release highlights:
* Multi-node integration tests
* Basic query metatdata framework
* Many valgrind/helgrind fixes
* More C++11 migration (std::scoped_ptr, unique_ptr)
Code improvements:
* DM-2720: Migrate boost::scoped_ptr to std
* DM-2953: Migrate auto_ptr --> unique_ptr
* DM-2803: Adapt multi-node tests to latest version of qserv / loader
* DM-2643: Migrate Qserv to ssi v2
* DM-2892: Keep track of database of the director table
* DM-3091: Remove unused function populateState
New features:
* DM-2627: Add support for configuring multi-node integration tests
* DM-2804: Implement query metadata skeleton
* DM-2858: Add support for "ORDER BY f1, f2" for has-chunks query
Bug fixes:
* DM-2777: Fix races in BlendScheduler
* DM-2779: Fix race in Foreman
* DM-2854: Fix Qserv SsiSession worker race
* DM-2681: Fix race condition in userQueryProxy
* DM-2935: Fix qserv-admin CREATE NODE failure
* DM-2982: Fix qserv-admin node status INACTIVE failure
* DM-2864: Fix selection of rows by objectId from non-director table
* DM-2945: Fix wmgr service on remote interfaces
* DM-2947: Fix data load of secondary index in multi-node case
Documentation improvements:
* DM-2841: Add User Manual
* DM-3018: Update dev quick-start guide for new qserv_testdata repo
* DM-2846: Remove hardcoded username from doc/publish.sh
R E L E A S E 2015_05
=======================
Release highlights:
* Migration to C++ 11 (thread, shared_ptr)
* Improvements for gcc 4.9.2
Code improvements:
* DM-1541: Add support for transmitting [VAR]BINARY column data
* DM-1540: Add support for BIT columns
* DM-1901: Re-implement data loading scripts based on new worker control service
* DM-2593: Client API for new worker management service
* DM-2711: Migrate boost:thread to std::thread
* DM-2712: Migrate boost::shared_ptr to std::shared_ptr
* DM-2730: Qserv code cleanup
* DM-2714: Make valgrind happier
New features:
* DM-1716: Implement query killing through Ctrl-C
* DM-2341: Use parallel ssh to manage Qserv on IN2P3 cluster
Bug fixes:
* DM-2698: Fix connection leak
* DM-2716: Fix connection leak (2nd iteration)
* DM-2710: Mutex use before creation
* DM-2708: Understand race condition in Executive::_dispatchQuery
* DM-2762: Avoid leaking memory allocated by mysql_thread_init
* DM-2682: Add missing empty-chunk-path on Ubuntu 14.04
* DM-2683: Fix case05 3009_countObjectInRegionWithZFlux freeze
* DM-2679: Fix default LOAD DATA options
* DM-2760: Data loader fails to decompress compressed data
* DM-1715: Add missing includes unistd.h for gcc 4.9.2
* DM-2729: Fix a few more g++ 4.9.2 compatos
Documentation improvements:
* DM-2630: Document configuration tool main use cases
R E L E A S E 2015_04
=======================
Release highlights:
* Switched to C++ 11
* Introduced dependency on flask
* Queries with large results (>2MB) are now properly handled.
* Query cancellation works, however multiple consecutive Ctrl-C
are not handled yet.
Code improvements:
* DM-2177: Implement worker-side squashing
* DM-1692: Implement "unlimited" result size handling
* DM-2469: Turn on C++ 11 flag for Qserv
* DM-2497: Fix g++ 4.9 return value implicit conversion incompato
* DM-2519: Check for Qserv processes at configuration tool startup
* DM-2595: Symlink data directory at configuration
New features:
* DM-2419: Implement authentication mechanism for worker management service
* DM-2385: Implement data loading in worker manager service
* DM-2617: Fix engine type in loader for index table
* DM-2618: Drop PK on overlap tables in data loader
* DM-2411: Allow qserv-admin.py to delete a node
Bug fixes:
* DM-2547: Fix again interface between QservOss and new cmsd version
* DM-2481: Fix intermittent race condition in worker
* DM-2552: xrootd can't be started via ssh
* DM-2629: Fix build for gcc 4.7.2 and gcc 4.8.2
R E L E A S E 2015_03
=======================
Code improvements:
* DM-202: Qserv: unit testing (query execution)
* DM-2387: Build testQDisp.cc on ubuntu
* DM-2390: Errors need to be checked in UserQueryFactory from QuerySession objects
New features:
* DM-1900: Worker management service - design
* DM-2176: Worker management service - impl
* DM-998: Adapt integration test to multi-node setup v1
Bug fixes:
* DM-1841: Fix query error on case03: "SELECT scienceCcdExposureId FROM
Science_Ccd_Exposure_Metadata"
* DM-854: duplicate column name when running near neighbor query
* DM-2451: Fix interface between QservOss and new cmsd version
* DM-2417: Data loader script crashes trying to create chunk table
* DM-2294: Unable to start cmsd on Qserv worker node
Documentation improvements:
* DM-2190: Documentation for data loader
* DM-2309: Update dev quick-start guide to new git repositories
R E L E A S E 2015_02
=======================
Code improvements:
* DM-215: Implement C++ geometry primitives for Qserv
* DM-216: Switch Qserv to C++ geometry primitives
* DM-1952: Change log priority for message "Unknown column 'whatever' in 'field
list'"
* DM-548: rearchitect Qserv to fix dependencies between modules in qserv/core
* DM-335: Migrate std::lists to std::vectors
* DM-1570: Create integration test case using data duplicator
* DM-1145: Remove code made obsolete
* DM-1715: Disable query killing
* DM-322: Trim python importing by czar in app.py
New features:
* DM-646: Implement DISTINCT aggregate in qserv
* DM-1618: Implement distributed database creation
* DM-1619: Implement distributed table creation
* DM-1617: Client library for accessing distributed database/table information
from CSS
Bug fixes:
* DM-1842: Fix encoding problem in qserv-czar.log
* DM-1784: Fix errors in parsing or rendering nested expressions
* DM-2058: Data loader should always create overlap tables
* DM-681: Parser ignores syntax after LIMIT
* DM-1888: scons install pass even if scons unit test fails
* DM-1974: Fix enclose, escape, and line termination characters in
qserv-data-loader
* DM-2157: Data loader crashes on uncompressed data.
Documentation improvements:
* DM-814: Cleanup in core/examples and core/doc
R E L E A S E 2015_01
=======================
Code improvements:
* DM-1720: Make secondary index for director table only
* DM-1762: Export SUI data (DC_W13_Stripe82_subset)
* DM-1742: Remove swig/antlr from Qserv system dependency list
* DM-1677: multi-error utility class
* DM-1213: cleanup order/grouping of header files
* DM-370: improved how default values for CSS are handled
* DM-1090: Log now takes a char const* format
* DM-1919: Address misc. compiler warnings
* DM-1917: Fix missing virtual destructors
New features:
* DM-627: Switch to using new partitioner, loader
* DM-520: Remove old partitioner/ loader and duplicator
* DM-1616: Implement remote host access for management framework (workerAdmin)
* DM-1615: Design and implement CSS structure for distributed Qserv setup
* DM-1046: W15 Central State System, support for db/table/query metadata
* DM-1037: W15 Loading data into distributed Qserv-managed databases
* DM-1755: Create an integration test case with GB-sized data
* DM-1844: Qserv tested on SL7
Bug fixes:
* DM-1886: qserv-admin crash in DUMP EVERYTHING
* DM-1582: Qserv spatial restrictor names are case sensitive
* DM-1743: CSV reader for Qserv partitioner doesn't handle no-escape and no-quote
options properly
* DM-737: Rendering an IR node tree should produce properly parenthesized output
* DM-655: unknown column derails Qserv
* DM-1673: Allow SWIG override for broken SWIG installations
* DM-1744: Fix SWIG_SWIG_LIB empty list default value
* DM-1732: Fix bug with 2 results table with same id
Documentation improvements:
* DM-1792: Update documentation and automatic install script w.r.t. new
newinstall.sh script
* DM-1658: Document 'git bisect' use
* DM-1658: Improve command-line ReST documentation
* DM-1822: Fix bug related to mysql empty string
R E L E A S E 2014_12
=======================
Code improvements:
* DM-336: Improve code that initializes shared pointers
* DM-1621: Add unit test to to verify zookeeper versioning works
New features:
* DM-621: User friendly single node loading script
* DM-1678: Handling of overlap parameter in new data loader
* DM-1653: Extend data loading script to support multi-node setup
Bug fixes:
* DM-1601: Fix related to queries with c-style comments
* DM-1603: Fix qserv build to use eups version of SWIG
* DM-1661: czar log4cxx link/load bug on Ubuntu 14.04
Documentation improvements:
* DM-1538: Dev documentation
R E L E A S E 2014_11
=======================
Code improvements:
* DM-1395: Reimplement CSS using JSON-packing, czar kazoo + c++ snapshotting phase 2
* DM-1252: Implement structure for DB/table metadata in CSS
* DM-1453: Add data versions to Zookeeper
* DM-1539: Add support for mysql JDBC driver
* DM-658: Database name used by integration tests should use their own dedicated
database, not "LSST"
* DM-1338: Make QSERV_RUN_DIR scripts able to detect qserv install paths using eups
* DM-1506: Support new version of newinstall.sh
* DM-1446: Fine tune czar and worker database initialization
* DM-1428: Add return codes for qserv-check-integration.py and qserv-testunit.py
New features:
* DM-1497: Package Qserv mono-node instance in Docker
Documentation improvements:
* DM-1475: Fix 2014_09 documentation
Known issues:
* Problems with swig 1.0 (Fedora 19 and Ubuntu 14.04 ship with 1.0).
R E L E A S E 2014_10
=======================
Code improvements:
* DM-1210: Invert buffering for czar in row-based result handling
* DM-1249: Reimplement CSS using JSON-packing, czar kazoo + c++ snapshotting, #1
Bug fixes:
* DM-1360: Fix minor loose ends from new result plumbing
* DM-1381: Fix testFacade - make the location random
* DM-513: Fix threading issues in CSS watcher
* DM-1279: Fix Scisql deployment test error (doc.py)
Documentation improvements:
* DM-1287: Propose and document a recipe to build Qserv in eups
R E L E A S E 2014_09
=======================
Code improvements:
* DM-198: Rework JOIN support, including Ref*Match tables
* DM-199: Develop new master-worker result system
* DM-207: Migrate Qserv czar code to the new logging system
* DM-1005: Migrate Qserv worker code to the new logging system
* DM-602: Add support for installing qserv on machines without internet
* DM-750: Integrate sciSQL in eups
* DM-953: Move qserv-testdata.py to qserv_testdata package
* DM-518: Rework exceptions in qserv client
* DM-1152: Css C++ client needs to auto-reconnect
* DM-648: Add support for running unit tests in scons
* DM-666 Partition package has to detect eups-related boost
* DM-1147: Create a top-level qserv_distrib package
* DM-1055: Remove unnecessary pieces from qserv czar config
* DM-559: Clean up include <> --> "" for third party includes
Bug fixes:
* DM-800: Zookeeper times out
* DM-664: "out of range value" message when running qserv-testdata (loader.py)
* DM-863: near neighbor does not return results
Documentation improvements:
* DM-1118: Improve documentation of code from DM-70
R E L E A S E 2014_08
=======================
Code impromements:
* DM-220: Reworked new xrootd client
* DM-70: Integrated Qserv with the new xrootd client
* DM-321: Redid threading and dispatching
* DM-366: Refactored install/distribution procedures using lsst-sw
* DM-869: Added flag to disable unused-local-typedefs warning
* DM-320: Renamed several modules and test programs
* DM-999: Renamed config files
Bug fixes:
* DM-989: .my.cnf in user HOME directory breaks setup script
* DM-1022: Fix warnings related to libraries pulled through dependent package
* DM-1054: init.d/qserv-czar needs LD_LIBRARY path
* DM-1029: "source" command is not in standard shell
Documentation improvements:
* DM-930: Updated documentation and migrated to REST format
* DM-649: Framework for documenting "how to run Qserv"
R E L E A S E 2014_07
=======================
Code improvements:
* DM-626: Reworked Qserv configuration scripts
* DM-595: Reworked configuration to support for multi-node
R E L E A S E 2014_06
=======================
Bug fixes:
* DM-786: Fixed problems with JOIN queries
* DM-516: Fixed race conditions in metadata
* DM-782: Fixed issues with automated tests related to column names
* DM-794: Fixed issues related to potential SQL injection
Code improvements:
* DM-622: Refactored Qserv configuration to simplify code development
* DM-710: Simplified client configuration
* DM-817: Switched to using stack-based boost
* DM-742: Switched to using geometry from geom package
R E L E A S E 2014_05
=======================
Bug fixes:
* DM-630: Non-partitioned table query returns duplicate rows
* DM-656: Selecting from non-paritioned table is broken
* DM-626: ORDER BY and DISTINCT do not work reliably in qserv
* DM-633: Query sessions are never destroyed
* DM-625: Too many connections from czar to zookeeper
* DM-531: Qserv returns error table instead of error code
* DM-372: fix testQueryAnalysis
* DM-328: mysql-proxy fails to stop
* DM-298: restarting mysqld breaks qserv
* DM-282: Make sure new metadata exceptions do not crash a qserv czar
* DM-596: Fix automated tests after css migration
Code cleanup:
* major cleanu pof includes in Qserv core modules (DM-313, DM-560)
* cleanup extra file names in docstring
* removed dead code (DM-337, DM-612)
Improvements:
* renames and reorganizations
* DM-699: rename git repository qservdata to qserv_testdata
* DM-614: rename qserv_admin.py to qserv-admin.py
* DM-509: rename "dbGroup" to "storageClass" in CSS metadata
* DM-597: reorganize client module
* DM-514: Switch to the "czar" name consistently
* DM-290: Eliminate dependence of query analysis on parser and antlr
* tweaks to internal zookeeper metadata:
* DM-508: shorten internal names in zookeeper
* DM-510: Tweak metadata structure for driving table and secondary index
* improvements to packaging/install/build system
* DM-611: Switch kazoo version to 2.0b1 or later
* DM-546: scons rebuilds targets without changes
* DM-355: Install and tag multiple Qserv versions on the same distserver
* DM-405: Write Linux Standard Base - compliant init.d scripts
* DM-623: Package antlr 2.7 in eups
* DM-365: Integration tests dataset should be packaged in eupspkg
* improved exceptions / error handling
* DM-470: Rework exceptions in css (python side)
* DM-208: catch exceptions from CSS
* DM-278: Improve handling errors occuring in AsyncQueryManager
* DM-604: Update parse/analysis tests to detect missing css-kvmap early
New features:
* Finished implementation of XrootD client and investigated
how to connect it with Qserv (DM-221, DM-222, DM-291)
* DM-481: Unit tests install directory
* DM-228: Setup dev test environment
* DM-460: Implement backup/restore for CSS
* DM-52: Qserv configuration - detailed design
Tested and verified:
* selections from partitioned tables and non-partitioned tables, both simple (eg by objectId) and more complex
* area selections (e.g. distance from a point)
* full table scans
* scisql astrometry conversions (eg flux to mag)
* ORDER BY
All enabled integration tests (34) pass cleanly.