u/circusboy
circusboy
circusboy
Same. All of my tables and columns are commented with json strings. The ddl files are copied into the repo. All of the sprocs exist as files, all of the jobs jsons are in the repo. So i now have context of the data with descriptions and sample values for everything. I have context for failures and job successes. I have context for lineage. I am now able to ask any round about prompt against my repo, a tool to perform the queries, one to connect to viral, another to connect to databricks, etc. Etc. It is working pretty well.
circusboy
SLOP IT UP, BOYS!
circusboy
This is what I've been doing. Ill admit I've been having A LOT of cool things happening, but that token usage is through the roof! Fine, no junior devs to train? Ill use the fuck out of the tokens so you wish you didn't fire my team. I got to 633% as of EOD today, and i was off a full week at the beginning of the month. Fuck em!
circusboy
I think it will depend on how you plan to use it. Is it a neat new tool, yes. will it automatically fix all your pipeline woes? doubt it.
Can it do cool shit? depends on your imagination i guess. We got access to it via github copilot extension in VSCode, along with all of the other major players in the LLM space via enterprise license, so we are able to use it carte blanche.
with that said. i have done a number of things over the last 2 weeks.
Built a form input web app to push data to a snowflake table. hosted by databricks apps. --i didnt need any other infrastructure which was nice. 1 hour 20 minutes from initial prompt to fully functioning and hosted simple webapp.
I have been doing A LOT of heavy lifting in my snowflake DB over the last few months. things like data categorizing, describing, etc all via json within column and table comments. i was able to analyze a table today that was 3b records with 96 columns. in almost 2 hours. extracted the analysis (which was quite good despite some issues), extract the analysis to a word document report, and a powerpoint executive summary.
Another webapp hosted on databricks, that stole the scripting from jsoncrack to display all of the executed query stats and explain plans i have been collecting. connect it to the table in snowflake, display the variant column in the graph area. i did ZERO coding to get this done, it simply ripped off another site.
Yesterday i vibe coded an executable that i could hare across the greater team to get them setup with all of the tools we are being pushed to use by management. double click the icon and it will scan the machine and install anything missing, from VSCode with the required extensions and python, as well as go to jfrog so that the users can register their tokens to access the pip artifactory.
im also doing standard DDL and DML work from VSCode by prompting what i want now that i have a connector file defined in python. i just tell claude to login to the snowflake account and drop a table by name. it does it. I was able to restore a dropped table via timetravel as well by specifying the date it was dropped on. it just writes the .py scripts for me and executes them. it shows me the scripts so i can review then before i allow it to do its thing in terminal.
all of that said. i can only imagine how much this is costing my company, but they dont seem to give two shits. so im figuring I would engage in some malicious compliance and get EVERYONE using it to blow up the costs. i probably used enough water to hydrate a small city over the last couple of weeks though.
VERY cool tool set to have, but it definitely feels icky to use.
23 yrs xp at a fortune whatever company.
circusboy
Umami flavor is from MSG. monosodium glutamate. Some boxed seasoning blends state no MSG, but others include it.
circusboy
But mah converged! Don't you know we landed a deal that allows us to sell other's fiber as ATT? We are resellers now!
circusboy
They are. Stock goes brrr, so does C-suite pay. And what's the easiest way to make stock go brrr????? SURPLUSES and RTO!
circusboy
I've been told just this week by a DBricks employee that I'm working with that DBFS is going bye bye. Moving to unity catalog which is iceberg. It's going to help us out in regards to cost cutting "hehe maybe/hopefully" if we use iceberg for our storage for DBricks and snowflake. Our UC clusters won't write to DBFS either. Legacy clusters won't write to UC.
circusboy
I'm a recent transplant from another state. Is it legal to bring an ice chest of beer to a park and drink/people watch?
circusboy
My first victory in 26 years!
circusboy
Married 26 years. What is mine is hers. What is hers is hers. What is hers is mine as long as she doesn't know.
circusboy
Those tournaments were neat to witness. I didn't work them, thankfully, but I remember my wife having to put on her yellow poketrainer t-shirt for work Saturday morning :)
circusboy
The automod deleted my last post with the inventory link... https://www.tcgcollector.com/dashboard?viewUser=jojos_circus
Not looking to sell, just share. That binder kept them in good shape too. None are graded, but most are super close to mint.
circusboy
I find it is decent enough as a replacement for googling things in helping to fix syntax issues out of the box.
Don't know how to construct a qualify statement/too lazy? Perfect example.
Relying on it to build a query to get a proper answer from a database out of the box? No way in hell.
My team is doing work in this space right now. It is tedious to say the least. The amount of hoops you have to jump through just to prep the DB/schema/tables to work with an LLM is kind of crazy. You need SMEs that know the data in order to prep the tables for answering. You need tons of descriptions on the tables/columns, you need business rules to help it know how to approach the question. And we are relying heavily on question/query pairs for training the agents. We haven't gotten to the point where we trust a single table query yet, much less introducing joins.
I know it is crawl/walk/run, but the business will continue to move fast and someone will have to keep up with inputs/questions/data cleaning for it to continue to work.
I really only see this whole exercise as a shift in how we work, not yet at the point of "gaining efficiencies" in regard to manpower needed.
circusboy
This is what I've been learning lately as well. Also if your resultset from the CTE is massive, then include an order by so that the datasrlet from the CTE will be clustered properly.
If the select within the CTE is the bottleneck, then you will want to see what the originating table/view is clustered by and use that in your where if possible. Reclustering that table could be expensive as well.
circusboy
If you ave a personal account "con or consumer" with a foundation account number "fan" then you probably just have a discount, or your account could have been created via some system that has an auto populated fan ID. It doesn't really matter, though. Fans are just an id that attach account level things to it, most normally discounts.
Liability status is something else entirely. Con,IRU or cru. The only time a fan should cause concern is if you are an individual liable account with a CRU type fan, but to be honest with you, you haven't really stated what the actual problem with your account is.
circusboy
I understand now, yeh. Tatum vibes all the way. "My name, Jeff."
circusboy
Mais, He played a good coullion, cher!
circusboy
Idiot thug, lol. Look up troy Landry from swamp people, or the assistant coach on the water boy. Accent was pretty spot on tbh.
circusboy
I actually liked his accent. It was a pretty good deep bayou attempt. Just enough waterboy assistant coach added to the mix. He used coullion too. That one threw me, happy cajun here.
circusboy
We had a SAS cluster setup that was called THE LAMER ENVIRONMENT. For a fortune 100 company. LAMER was the admin dude's last name.
circusboy
I've read a ton of the forgotten realms books back in the day when I found a load of pdfs before e readers. There are a ton of good ones that I can't remember.
I've never been a fan of greenwood's writing style, maybe because I started with elminster in hell, idk, couldn't stick with it.
Erevis Cale books by Paul s Kemp are a strong contender to Salvatore. Very similar writing style. Would honestly love to read more.
Also, Salvatore has books not In the forgotten realm space, also great reads, and of course there is the cleric quintet.
circusboy
They are building a skate park at Thomas Park right now. Last saw the start of it about a month ago. There is also a walking path that is cement.
circusboy
Yep, instead of reborn, summon from hand where hand pirates get Eliza buff too. Keep em as low hp glass canons though.
Lafayette native, living in buckhead. This is the answer. They make at least weekly trips to Lafayette and breaux bridge to restock. They have all the things. Comeaux's tasso and andouille, some stuff from poches. They even had some meches king cakes around mardi gras. They also do turduckens for thanksgiving.