Tuesday, December 15, 2015

Carbonated SQLCL - aka SODA support

Oracle Database 12.1.0.2 introduced JSON support. This is supported in REST Data Services already and now in the latest SQLCL. This means ORDS can serve up the access to client applications and developers can have a command line way to interact and test features/queries/... in a nut shell a shell for JSON document storage. To use this feature the database will be to have patch #20885778 applied.

There's a lot in there for command so give them a try. SODA is underpinned but tables with JSON data in them. It's very easy to get going testing out the SODA features. Here's a simple collection create, insert, and query.

JavaScript and SODA

Here's a quick example of using the SODA libraries from javascript. Also in here is a new feature of scripting. The javascript can be inlined into a sql script. Notice that it's soda.sql <<< .sql that has javascript in it, let that sink in for a minute with the possibilities.

Gory Details of the release

Someone asked about change logs for these SQLCL updates. Here's a filtered version of the gory details

------------------------------------------------------------------------
Changed CD to look at absolute paths and changed FileUtils to respect them on windows too.
------------------------------------------------------------------------
fixed auto append of .js when there's a ../ in the path
------------------------------------------------------------------------
New sql.exe to pick up last carsten fix
Also changed auto js fix to File.separator as it doesnt work on Windows \. Now seems good
------------------------------------------------------------------------
Added history for script as well.
------------------------------------------------------------------------
Bug 21304531 - precision of interval day to second
------------------------------------------------------------------------
20950786: converting normal table/owner names to upper case, so that quoteIdentifier won't quote lower case names
------------------------------------------------------------------------
Bug 21543451 - set numformat 9 is not supported
------------------------------------------------------------------------
Bug 21976274 - edit buffer file being written to different directories based on cd commands
------------------------------------------------------------------------
Bug 21971064 - run ddl command when disconnected get parse error
------------------------------------------------------------------------
Bug 21971059 - syntax issue in help topic for 'ddl' command
------------------------------------------------------------------------
Bug 22076298 - info "public".dbms_output get npe
------------------------------------------------------------------------
Bug 22095255 - repeat command does not work fine when iterations is large
------------------------------------------------------------------------
Bug 22075376 - desc fail while more than one space exist between desc and object name
------------------------------------------------------------------------
Bug 21892799 - parameters need to be added in syntax for alias drop
------------------------------------------------------------------------
Bug 21381415 - set numformat is not working with binary_float and binary_double type
------------------------------------------------------------------------
Bug 22095190 - repeat command should check for the valid values of iterations and seconds
------------------------------------------------------------------------
Bug 21662069 - justify option of column command is not displayed
Some cleanups in the code for number formats.
------------------------------------------------------------------------
Bug 21482640 - the noprint column is counted for linesize
------------------------------------------------------------------------
Bug 21430771 - a label of compute is always single quoted in sql*plus
------------------------------------------------------------------------
Bug 21477780 - null clause of column command should override the value set by set null
------------------------------------------------------------------------
Bug 21477780 - null clause of column command should override the value set by set null
Have a better fix now.
------------------------------------------------------------------------
opened up repeat more than just sql
------------------------------------------------------------------------
Bug 21111361 - some invalid options for set autocommit are now seems to be valid
------------------------------------------------------------------------
Bug 22142042 - col format does not work fine
------------------------------------------------------------------------
Adding guards around keymap identification as it seems to be null for Christoph Ruepprich. Its working fine here, but from the stack trace, the NPE points to a null keymap
------------------------------------------------------------------------
Added orajsoda
Fixed csv not using the nls settings
misc things with repeat
------------------------------------------------------------------------
forcing full redraw for insight on sqlcl where there is only one completion item.
------------------------------------------------------------------------
Added set clear to allow clear screen to go to the bottom. Insight now refreshes correctly on single and multi option.
------------------------------------------------------------------------
Removing ALIAS error code setting from succesful codes
------------------------------------------------------------------------
Bug 20871360 - DESC OR INFO DOESN'T SHOW SCHEMA NAME IF CREATE TABLE USING TYPES OF OTHERS
------------------------------------------------------------------------
Bug 22095255 - repeat command does not work fine when iterations is large
added Integer.MAXVAL to messageformat tocomplete the message
------------------------------------------------------------------------
fixed spaces in the file name for save
fixed that when save specified it does not also print to stdout
------------------------------------------------------------------------
Bug 22107961 - INFO TABLE: NO SIZE FOR RAW TYPE
------------------------------------------------------------------------
Bug 22083173 - INFO TABLE: UNNEED LENGTH SEMANTICS INFO FOR NCHAR TYPE
------------------------------------------------------------------------
Re Kris: colored completion
------------------------------------------------------------------------
Re Kris: set color on -- toggles completion color
------------------------------------------------------------------------
All documentation SQL formatting tuned.
------------------------------------------------------------------------
Bug 21102872 - SET AUTOCOMMIT 0 DOES NOT WORK AS EXPECT
------------------------------------------------------------------------
Bug 20872793 - DESC IS NOT DESCRIBING A TYPE CORRECTLY WHEN CREATED USING INTERVAL
------------------------------------------------------------------------
Bug 21102741 - SET AUTOCOMMIT SHOWS THE SAME ERROR FOR DIFFERENT TYPE OF INVALID OPTIONS
------------------------------------------------------------------------
Bug 21104192 - SET AUTOCOMMIT ON COMMITS ON EVERYTHING
------------------------------------------------------------------------
Bug 21112625 - SET APPINFO WITH A LONG TEXT DOES NOT GET ERROR
------------------------------------------------------------------------
Bug 21381052 - long is not used when print nclob data
Fix is only for select query.
------------------------------------------------------------------------
change save ddl to respect quoted filenames
------------------------------------------------------------------------
Changed new commands to be bold + underline. People using white terminals couldn't see the white text and there's no way I could find to determine the color of the terminal
------------------------------------------------------------------------
Changed to look for ojdbc8 not 6 as 6 is very old at this point
------------------------------------------------------------------------
Cleaned up the set feedback section
------------------------------------------------------------------------
Adding dependency for SODA
------------------------------------------------------------------------
Bug 21477290 - "" and '' should be invalid when used as column_name in column command
------------------------------------------------------------------------
First update to enable REST services integration
------------------------------------------------------------------------
Adding nohistory blacklist for sqlcl. What do you not want persisted? Add it here.
nohistory set,connect,show,load,whatever
show nohistory
BARRY@orcl🍻🍺 >nohis show,set,connect,nohistory,history
BARRY@orcl🍻🍺 >his clear
History Cleared
BARRY@orcl🍻🍺 >show nohistory
NOHISTORY: show,set,connect,nohistory,history
BARRY@orcl🍻🍺 >set echo on
BARRY@orcl🍻🍺 >select 1 from dual;
1
1
BARRY@orcl🍻🍺 >his
1 select 1 from dual
BARRY@orcl🍻🍺 >
------------------------------------------------------------------------
BUG 21843939 - SET PAUSE WITH INVALID GET NO ERROR
------------------------------------------------------------------------
Added option to specifiy delimiters with the set sqlformat command. set sqlformat delimited | ' '
------------------------------------------------------------------------
Rolling back parser changes so all work is done in set nohistory.
BARRY@orcl🍻🍺 >his clear
History Cleared
BARRY@orcl🍻🍺 >set nohistory set,show connect
BARRY@orcl🍻🍺 >show nohistory
NOHISTORY: set,show,connect
BARRY@orcl🍻🍺 >set echo on
BARRY@orcl🍻🍺 >show echo
echo ON
BARRY@orcl🍻🍺 >his
BARRY@orcl🍻🍺 >
------------------------------------------------------------------------
Bug 22241225 - SQLCLI : COPY FROM.. COMMAND FAILS TO CONNECT
------------------------------------------------------------------------
Bug 21762251 - TABLE WITH LONG DATATYPE COLUMN CAN NOT BE COPIED
------------------------------------------------------------------------
Bug 22244310 - history help is invalid
------------------------------------------------------------------------
Bug 21625285 - ERROR FROM SQLCL DOES NOT TELL THE REAL REASON WHEN COLUMN NUMBER DOES NOT MATCH
------------------------------------------------------------------------
Added soda create, soda list, soda get, soda drop, soda insert
------------------------------------------------------------------------
Set property fixed. so set property http_proxy http://www-proxy.us.oracle.com:80 etc now works again.
set ddl options fixed so all options now work.
added ade changes for build in rdbms_trunk (in or out of view)
------------------------------------------------------------------------
make sure ctrl c stops the printing of a result set when the sqlformat is not default. Ex when set sqlformat ansiconsole. Make sure ctrl c works the same as when sqlformat is default
------------------------------------------------------------------------
CTRL-c is now working in ansiconsole, but there is a null passing through the exception handler, which we need to prevent.
------------------------------------------------------------------------
Fixed url's over proxies specifically over http_proxy and https_proxy
------------------------------------------------------------------------
Fixed ctrl-c in editor, so it exits back to the prompt.
------------------------------------------------------------------------
Case enum has to be visible to DBConfig
------------------------------------------------------------------------
Added ability to filter failed commands from the history. history fails now flips between showing and hiding the failures in running.
Also amended aliases to show descriptions so we can see what an alias does.
------------------------------------------------------------------------
Plugged in new formatter
------------------------------------------------------------------------
Adding record counts and pretty print.
------------------------------------------------------------------------
Bug 21460696 - SET NUMWIDTH TO AN INVALID VALUE GET NUMBERFORMATEXCEPTION
------------------------------------------------------------------------
Bug 22244801 - some history abbreviations are not supported
------------------------------------------------------------------------
Bug 22132269 - repeat command get arrayindexoutofboundsexception when no history and no buffer
------------------------------------------------------------------------
Bug 22244310 - history help is invalid
------------------------------------------------------------------------
Added support for soda remove and more exception handling.
------------------------------------------------------------------------
Setting pagesize to 0 will just display data with Paging turned off.
------------------------------------------------------------------------
Bug 22172130 - missing '>' in help of format
------------------------------------------------------------------------
Bug 22252847 - help:net: <sql statement=""> should something else
------------------------------------------------------------------------
Added support for additional options in soda get.
------------------------------------------------------------------------
Merged soda get and soda find. Added additional optional arguments for soda get.
------------------------------------------------------------------------
Bug 21822565 - DESC A PACKAGE GETS 0 AS THE SIZE OF SOME DATATYPE
------------------------------------------------------------------------
Bug 21111291 - SET AUTOCOMMIT CAN ACCEPT A NEGATIVE NUMBER
------------------------------------------------------------------------
Bug 21971072 - DDL COMMAND: ONLY UPPER CASE IS RECOGNIZED IN OPTION
------------------------------------------------------------------------
Bug 21636020 - DDL DOES NOT RECOGNIZE TABLE PARTITION AS OBJECT TYPE IF MULTIPLE OBJS W/NAME
------------------------------------------------------------------------
Bug 22005555 - DDL COMMAND:SHOW DDL OF TYPE BODY GET NPE
------------------------------------------------------------------------
Bug 22095455 - FAIL TO DESC SYNONYM FOR LOWER CASE TABLE
------------------------------------------------------------------------
Bug 22005616 - DDL COMMAND:SHOW DDL OF TYPE ALSO SHOW TYPE BODY
------------------------------------------------------------------------
Bug 22007103 - DESC A TABLE WITH A SPACE IN ITS NAME IS NOT WORKING FINE
------------------------------------------------------------------------
Bug 22133949 - ed is not editing the sql in buffer
------------------------------------------------------------------------
Bug 22132239 - repeat command should require a connection
------------------------------------------------------------------------
Bug 22311951 - repeat: it execute using 1s for sleep when sleep is not a number
------------------------------------------------------------------------
Feedback was broken in scripts
Fixed xquery issues in set
Bug 21375193 - set xquery node default is throwing exception
------------------------------------------------------------------------
xquery set issues whe brought out to all commands. Tightened checks.
------------------------------------------------------------------------
Title(Top & Bottom) commands should work with COLUMN commands NEW_VALUE and OLD_VALUE.
This is fixed now.
------------------------------------------------------------------------
Bug 22095122 - DESC NOT WORK FOR SAME SYNONYMS IN DIFFERENT SCHEMAS
------------------------------------------------------------------------
Added restrict to host. Need to check others too.
------------------------------------------------------------------------
Added a check to make sure unnecessary header lines are not added.
------------------------------------------------------------------------
Filed thru restrict and fixed all permissions.
Command Level 1 Level 2 Level 3
EDIT disabled disabled disabled
GET disabled
HOST disabled disabled disabled
SAVE disabled disabled
SPOOL disabled disabled
START disabled
STORE disabled disabled
------------------------------------------------------------------------
Bug 21609843 - COPY COMMAND SHOULD FAIL IMMEDIATELY WHEN USERNAME IS NOT SPECIFIED
------------------------------------------------------------------------