






Words, Art & Science by Anthony Francis
It’s what happens when we’re not working or playing or thinking or doing. That thing we do that doesn’t fit into all the other categories.
Sometimes we call it living.
So, when I say "I teach robots to learn" ... that's what I do. -the Centaurhttps://arxiv.org/abs/1710.03937 PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planning
We present PRM-RL, a hierarchical method for long-range navigation task completion that combines sampling-based path planning with reinforcement learning (RL) agents. The RL agents learn short-range, point-to-point navigation policies that capture robot dynamics and task constraints without knowledge of the large-scale topology, while the sampling-based planners provide an approximate map of the space of possible configurations of the robot from which collision-free trajectories feasible for the RL agents can be identified. The same RL agents are used to control the robot under the direction of the planning, enabling long-range navigation. We use the Probabilistic Roadmaps (PRMs) for the sampling-based planner. The RL agents are constructed using feature-based and deep neural net policies in continuous state and action spaces. We evaluate PRM-RL on two navigation tasks with non-trivial robot dynamics: end-to-end differential drive indoor navigation in office environments, and aerial cargo delivery in urban environments with load displacement constraints. These evaluations included both simulated environments and on-robot tests. Our results show improvement in navigation task completion over both RL agents on their own and traditional sampling-based planners. In the indoor navigation task, PRM-RL successfully completes up to 215 meters long trajectories under noisy sensor conditions, and the aerial cargo delivery completes flights over 1000 meters without violating the task constraints in an environment 63 million times larger than used in training.
Welp, that was anticlimactic! Thanks, God, for a smooth update to WordPress 4.7.3! (And thanks to the WordPress team for maintaining backwards compatibility). And hey, look - the Library has close to 1,000 posts!
Expect major site updates in the months to come, as WordPress’s Themes and Pages now enable me to do things I could only formerly do with static pages and hand-coded pages, and it will all be backed up easier thanks to WordPress’s Jetpack plugin.
The things you learn helping other people with their web sites ….
-the Centaur
Welp, it’s time: I’ve backed up the Library of Dresan three ways to Sunday, said a prayer … and now am planning to upgrade WordPress from 3.0.1-alpha-15359 to 4.7.3. I know that’s 1.7.2 full version numbers, but it’s been too long, and there are too many new features I need, so … time to press the button.
God, please help me! Everyone else, your prayers, please.
Lots of great content …
... and this year I have pages and pages of notes!
Stay tuned …
... or check the talks out in a few weeks on the GDC Vault!
-the Centaur
At long last, Jeremiah Willstone and the Clockwork Time Machine, my fourth published novel, is OUT in the world! You can get it wherever fine books are sold:
The Clockwork Time Machine tells the story of Jeremiah Willstone, a female adventurer from an alternate world called Victoriana, where, because women’s liberation happened a century early and twice as many brains ended up working on hard problems, science has advanced more in 1908 than it has in our world today - but inadvertently, these scientific advances attracted the attention of aliens called Foreigners, who have come calling to make this world their own!
When Jeremiah’s treacherous uncle steals a dangerous alien weapon and secrets it away on an airship to a possibly hostile shore, Jeremiah leads a strike team to retrieve it - and finds herself chasing him across the seas of time itself, with her uncle just possibly aiming to upend the entire world order she holds dear! With time running out, Jeremiah must sacrifice everything she is to save everyone she loves.
Enjoy!
-the Centaur
For those wondering what I’ve been up to for the last six months, the biggest thing is THIS …
At long last, JEREMIAH WILLSTONE AND THE CLOCKWORK TIME MACHINE is coming to print! We’ll be picking the actual release date in the next few days, but I can’t think of a better gift for my birthday than seeing the cover of my new novel!
Here’s a sneak peek at the back cover blurb:
From an Epic Award winning author comes a sprawling tale of brass buttons, ray guns, and two-fisted adventure!
In an alternate empire filled with mechanical men, women scientists and fantastic contraptions powered by steam, a high ranking officer in the Victoriana Defense League betrays his country when he steals an airship and awakens an alien weapon that will soon hatch into a walking factory of death.
Commander Jeremiah Willstone and her team must race through time in a desperate bid to stop the traitor's plan to use the alien weapon to overthrow the world's social order. With time running out, Jeremiah may have to sacrifice everything she is to save everyone she loves.
"Addictive, sassy, sexy, funny, intense, brilliant." -Bitten By Books, on Frost Moon
Epic Award winner Anthony Francis writes the Dakota Frost, Skindancer series and Jeremiah Willstone series while working on robots for "the Search Engine Which Starts with a 'G'."
Prevail, Victoriana!
-the Centaur
Welcome to the future, ladies and gentlemen. Here in the future, the obscure television shows of my childhood rate an entire section in the local bookstore, which combines books, games, music, movies, and even vinyl records with a coffeehouse and restaurant.
Here in the future, the heretofore unknown secrets of my discipline, artificial intelligence, are now conveniently compiled in compelling textbooks that you can peruse at your leisure over a cup of coffee.
Here in the future, genre television shows play on the monitors of my favorite bar / restaurant, and the servers and I have meaningful conversations about the impact of robotics on the future of labor.
And here in the future, Monty Python has taken over the world.
Perhaps that explains 2016.
-the Centaur
I’ve been going to conventions for about thirty-five years, but have appeared on panels only in the last ten, and even that only consistently for the last five - so I still feel like a fanboy up with all the more experienced authors. And while sometimes I have a lot to contribute, I often find it’s better not to ask whether I have something to say, but whether I have something to add. It’s frankly awesome to be up here with luminaries like John Ringo or Esther Friesner, and it’s often just best to to sit back and listen - but even then, don’t give up on yourself. I was on three panels today with more experienced people, and I made sure I both shut up and listened and stepped up and said something at the appropriate time - with the result being that several people came up to me and thanked me for my contribution to the panels that I’d been on. Several of the authors got together afterward, and we all seemed to think that it was our interactions with each other that made the panels great. So … think of what you can add, but never give up on your own unique contribution. It’s there, you just have to find it.
Pictured: the forward and reverse angle on viewer for a panel on “101 ways to kill a character” which I was on with John Ringo, who chose just the moment I took my selfie to lean over and ask someone a question.
-the Centaur
So, Labor Day is rolling around again, and once again, I’ll be at Dragon Con! I’m actually on a boatload of panels this year, but the most important one is my book reading, Sunday at 1PM at the Hyatt! Come on by and help me make this room:
look like this room:
I’ll be reading from THE CLOCKWORK TIME MACHINE, from the Dakota Frost series including both the published trilogy and the forthcoming books, and also I’ll likely read some of my flash fiction pieces! Come and enjoy!
If panels are more of your bag, however, I’ve got plenty for you:
Oh! Hey! I’m moderating one of them panels. Good to know! (Seriously, a year or two back I found out I was moderating a panel when I sat down, and I’d only found out about the panel ten minutes before). Regardless, come on down to Dragon Con and have fun!
-Anthony
I’m not dead, I’m just playing a game of this pays for that. The above is this - reinforcement learning for robotics. The below is that - writing. I want to be doing more writing, but I need to keep working to pay for the writing. That is all for now …
-the Centaur
I just finished a rough draft of Book 5 in the Dakota Frost, Skindancer series. I’d love to sit back and reflect on all the novels I’ve finished (3 published, one at the editor, 3 more drafts finished, 3 more beyond that partially finished, one in the sock drawer, and one half-finished novel that got away from me) but I have contracts to edit. So, for now, I’ll just leave this here...
Once again, I’ve completed the challenge of writing 50,000 words in a month as part of the National Novel Writing Month challenges - this time, the July 2016 Camp Nanowrimo, and the next 50,000 words of Dakota Frost #5, PHANTOM SILVER!
This is the reason that I’ve been so far behind on posting on my blog - I simultaneously was working on four projects: edits on THE CLOCKWORK TIME MACHINE, writing PHANTOM SILVER, doing publishing work for Thinking Ink Press, and doing my part at work-work to help bring about the robot apocalypse (it’s busy work, let me tell you). So busy that I didn’t even blog successfully getting TCTM back to the editor. Add to that a much needed old-friends recharge trip to Tahoe kicking off the month, and I ended up more behind than I’ve ever been … at least, as far as I’ve been behind, and still won:
What did I learn this time? Well, I can write over 9,000 words a day, though the text often contains more outline than story; I will frequently stop and do GMC (Goal Motivation Conflict) breakdowns of all the characters in the scene and just leave it in the document as paragraphs of italicized notes, because Nano - I can take it out later, its word count now now now! That’s how you get five times a normal word count in a day, or 500+ times the least productive day in which I actually wrote something.
Also, I get really really really sloppy - normally I wordsmith what I write as I write, even in Nano - but that’s when I have the luxury of writing 1000-2000 words a day. When I have to write 9000, I write things like "I want someoent bo elive this whnen ai Mideone” and just keep going, knowing that I can correct the text later to “I want someone to believe this when I am done,” and, more importantly, can use the idea behind that text to craft a better scene on the next draft (in this case, Dakota’s cameraman Ron is filming a bizarre event in which someone’s life is at stake, and when challenged by a bystander he challenges back, saying that he doesn’t have any useful role to fill, but he can at least document what’s happening so they’ll all be believed later).
The other thing is, what I am starting to call The Process actually seems to work. I put characters in situations. I think through how they would react, using Goal Motivation Conflict to pull out what they want, why they want it, and why they can’t get it (a method recommended by my editor Debra Dixon in her GMC book). But the critical part of my Process is, when I have to go write something that I don’t know, I look it up - in a lot of detail. Yes, Virginia, even when I was writing 9,000+ words a day, I still went on Wikipedia - and I don’t regret it. Why? Because when I’m spewing around trying to make characters react like they’re in a play, the characters are just emoting, and the beats, no matter how well motivated, could get replaced by something else.
But when it strikes me that the place my characters area about visit looks like a basilica, I can do more than just write “basilica.” I can ask myself why I chose that word. I can look up the word “basilica” on Apple’s Dictionary app. I can drill through to famous basilicas like the Basilica of Saint Peter. I can think about how this place will be different from that, and start pulling out telling details. I can start to craft a space, to create staging, to create an environment that my characters can react to. Because emotions aren’t just inside us, or between us; they’re for something, for navigating this complex world with other humans at our side. If a group of people argues, no matter how charged, it’s just a soap opera. Put them in their own Germanic/Appalachian heritage family kitchen in the Dark Corner of South Carolina, on on the meditation path near an onsen run continuously by the same family for 42 generations, and the same argument can have a completely different ambiance - and completely different reactions.
The text I wrote using my characters reacting to the past plot, or even with GMC, may likely need a lot of tweaking: the point was to get them to a particular emotional, conceptual or plot space. The text I wrote with the characters reacting to things that were real, even if it needs tweaking, often crackles off the page, even in very rough form. It’s material I won’t want to lose - more importantly, material I wouldn’t have produced, if I hadn’t pushed myself to do National Novel Writing Month.
Up next, finishing a few notes and ideas - the book is very close to done - and then diving into contracts for Thinking Ink Press, and reinforcement learning policy gradients for the robot apocalypse, all while waiting for the shoe to drop on TCTM. Keep your fingers crossed that the book is indeed on its way out!
-the Centaur